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Part I. 

Fluctuations in stochastic lattice gases 

I. Introduction 

A good way to learn about possible constructions of nonequilibrium 
statistical mechanics probably proceeds via the study of simple model 
systems. Traditionally, the so called stochastic lattice gases are play- 
ing there a prime role. A very early example is the Ehrenfest model. 
Not only was it important as one of the many urn models illustrating 
strategies and results from probability theory and from statistics, but it 
remains instrumental in learning about relaxation and about detailed 
balance, see e.g. [2H] where Mark Kac does not seem to hesitate in 
calling the Ehrenfest model one of the most important models in all of 
physics. We will encounter that Ehrenfest model in the first section. 

Over the last decades, many other lattice gas models have been in- 
vented. Often they appear attractive because they obey simple updat- 
ing rules and they are rather easy to visualize and to simulate (at least 
today). Yet, their behavior is rich, including sometimes clear examples 
of emergent behavior. The latter refers to the organization of robust 
structures or patterns, of critical behavior, and of phase transitions, 
which result from some collective or cooperative behavior between the 
many interacting components. They have appeared in interdisciplinary 
contexts, varying from models of traffic, to models of turbulence or to 
models for the spreading of infections, in computer science, in econ- 
omy etc. On the more mathematics side, we have here an interesting 
ground for exploring and extending the theory of spatially extended 
Markov processes. The role of the spatial architecture of the processes 
has recently been more in the center of attention, e.g. in discussions 
of processes on random graphs, small worlds etc. In recent versions, 
the architecture (or graph) also undergoes a dynamics, in interaction 
with the particles. Clearly these lattice gas models have proven their 
use already. A few books where mathematical and statistical mechani- 
cal introductions are found to the theory of lattice gases are [30, EE1 E2] • 

Many good references link stochastic lattice gases with fundamental 
problems in physics, be it in the context of turbulence or in the deriva- 
tion of hydrodynamic equations. In the present notes, we bring to- 
gether a number of recent results in the construction of nonequilibrium 
statistical mechanics, as they appear for some simple stochastic lattice 
gas. The emphasis will be mostly on formal relations, from which both 
mathematical and physics treatments can find inspirations. We hope 
that this provides some step in a wider understanding of nonequilib- 
rium issues in other and more realistic models. Indeed, one should 
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remain aware that stochastic lattice gases are often only effective tools. 
They are Markovian from the start and their transition rates depend 
on some ad hoc choices. They are stochastic and there is no specifica- 
tion of a larger environment. 

After a short reminder of aspects of a Markov dynamics for one 
particle, we introduce the main models in Section 3. That is continued 
in Section 4 where the steady state is further specified. In all that we 
work with a finite one-dimensional system on which there is a particle 
hopping in the bulk of the system and a birth and death process at 
the two boundary sites. We consider a time-dependent version of the 
dynamics in Section 5. The main tool is provided by a Lagrangian set- 
up in which a Girsanov formula specifies the action (Section 6). Section 
7 gives the main fluctuation relations in the form of a Jarzynski identity 
(relating the irreversible work with the change in free energy) and of a 
fluctuation symmetry in the particle current (a so called steady state 
fluctuation theorem). While the results are mainly well-known we are 
not aware of a similar unifying presentation in the literature. There 
remain however very many nonequilibrium issues which are not treated 
in these notes. Some remarks are devoted to them in the final section. 



2. One walker 

Consider the set K = {0, . . . , N} and the discrete time Markov 
chain with transition probabilities p(x, x') = x/N if x' — x — 1 and 
p(x, x') = 1 — x/N if x' — x + 1 for x, x' G K. One interpretation 
is to think of the state x G K as the number of particles in one of 
two vessels. The total number of particles over the two vessels is fixed 
equal to N . At each discrete time moment, one of the N particles is 
randomly selected and moved to the other vessel from where it was. 
That model is known as the Ehrenfest model (or dog-flea model). 
As a mathematical object we have here an irreducible (but not aperi- 
odic!) Markov chain (x n ) that satisfies the condition of detailed balance 
with respect to the stationary measure 

p{x) = 2~ N UA Nl - , x G K 
1 y ' x\(N - x)\ 

That condition of detailed balance 

p(x, x') p(x) = p(x',x) p(x') 

expresses the time-reversibility of the stationary process. Indeed, let 
P p denote the stationary process on K" 1 and define y n = X- n . The 
process (y n ) is Markovian with stationary law p. Its law is denoted by 
P P Q where O stands for time-reversal. We show that P P Q = P p as a 
consequence of the condition of detailed balance. The basic observation 
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is that the transition probability for the process (y n ) is via Bayes' 
formula 

q(y, y') = Prob[y n+1 = y '\y n = y }= p ( y ', y ) = p ( y , y ') 

Therefore, the condition of detailed balance is equivalent with the time- 
reversibility. 

There is an easy way to generalize the above set-up. Let us first make 
the step to continuous time. We are now speaking about rates c(x, y ) > 
(or, transition probabilities per unit time) for the transition x — > y. 
If we assume that 

c(x,y) =a(x, y )e [vix) - viy)]/2 
where a(x, y ) = a( y ,x) is symmetric, then still 

Cp, V) = c \V(x)~V(y)] / 2 _-q 

c( y ,x) 

and p(x) oc exp[— V(x)] is a reversible measure. 

A new interpretation arises when thinking of the set {0, 1, . . . , N} as the 
sites of a lattice interval, with the usual nearest neighbor connections. 
The rates c(x, y ) could be taken non-zero only if y — x ± 1 in which 
case we have a nearest neighbor walk. The condition of detailed balance 
(12.1 p assures that the walker will not drift; there is a potential landscape 
V(x), x = 0, . . . ,N which could be periodically repeated to cover all 
of Z if wished. 

There are ways to break detailed balance. One could for example 
insert a non-zero transition rate for moving between the states (sites) 
<-> N, and then take c(x, x + 1) = p, c(x, x — l) = q^p, N + 1 = 0. 
In that case, say with p > q there is a drift that the particle moves 
more x — > x + 1 than x — ► x — 1; there appears a net current. 
More generally, we can think of parameterizing the rates via 

c(x, y) = a(x, y) e ^)-v%)]/2 e s( x , y )/2 

where s(x,y) = —s{y,x) would be antisymmetric. It turns out that 
this term s(x,y) has often an interesting physical interpretation. In 
what follows we will see it related to the entropy production. The en- 
tropy production is a physical notion that has arisen within irreversible 
thermodynamics, see e.g [21] ■ It goes well with considerations close to 
equilibrium. The influence of the time-symmetric factor a(x,y) is less 
understood. 



The following sections will study some of the aspects above for multi- 
particle models. We now have a (possibly variable) number of particles 
and they move on the lattice following certain hopping rules. The 
effect of having many particles can result in (simpler) hydrodynamic 
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behavior for macroscopic variables such as the density profile, but we 
will concentrate on the fluctuations instead. 

3. Stochastic lattice gases 

We start with a description of what is typically involved in stochastic 
lattice gases. We do not give the most general definitions but we specify 
to one special class. 

3.1. States. By a lattice gas we understand a collection of particles 
whose positions are confined to the sites of a lattice. In some models 
the particles still have a momentum, most often with a finite number 
of possible values. Or, the particles can have extra decorations such 
as color or spin. Here we do not consider thatEl The system thus 
consists of identical particles that can jump from site to site on the 
given architecture. The states of the system are assignments to each 
site of the number of particles. To be specific we consider the finite 
linear chain A^v = {— N, —N+l, . . . , 0, 1, . . . , N—l, N}. The endpoints 
i = ±N in Ajv will play a special role in what follows; we call them 
the boundary of the system while the other sites are in the bulk. Two 
sites i,j are nearest neighbors when j = % ± 1. 

We allow at most one particle per site i. We say that site % can be 
vacant or occupied. The state space (or the configuration space) is the 
finite set K = {0, 1} Ajv . Elements of K are denoted by r], rj', £, . . . and 
we write 77(2) G {0, 1} for the occupation at site i <E A N . 

3.2. Energy, entropy and particle number. One imagines a func- 
tion H typically referred to as the Hamiltonian of the systemjl that 
measures the energy of the state rj. There is a great freedom of choice 
and all depends on the context or on the specific purpose. It does not 
hurt however to suppose something specific, say an energy function 
consisting of two terms: 

N N-l 

H( v ) = ~BJ2 ~ « E rt) V(i + 1), (3-1) 

i=-N i=-N 

where B and k are some constants. The first term contributes an en- 
ergy —B per particle being present in the system and the second term 
takes into account some form of nearest neighbor interaction related to 

4 An important ingredient of the Hamiltonian (or symplectic) structure is thus 
lost. In particular the kinematical time-reversal that would normally change the 
sign of the velocities is absent. 

5 It is of course not a Hamiltonian in the strict sense of analytical mechanics. The 
word Hamiltonian refers here more to the quantum world where one considers for 
example the hopping of electrons in a crystal structure. A mathematically precise 
correspondence, also for the dynamical properties, can often be achieved via the so 
called weak coupling limit or within the framework of Fermi's Golden Rule. 
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the relative concentration of particles on neighboring sites. 



Speaking of energy reminds us of its conservation law. We can indeed 
imagine that our system is in thermal contact with a very large heat 
bath at inverse temperature (3 (Boltzmann's constant is set equal to 
one), and for which all relevant changes are determined by the transi- 
tions in the system. In particular, every change H(rj') — H(rj) in energy 
of the system is accompanied with the opposite change AE(r),rf) = 
— (H(rf) — H(rj)) of energy in the bath@ Imagining that the energy 
change of the reservoir is thermodynamically reversible, we associate 
to it a change of entropy in the reservoir equal to 

AS res = PAE(r],r)') = -P(H(r/) - H(r,)) 

In other words, every change 77 — ^ 77' in the system's configuration en- 
tails an entropy flux, that is (3 times the heat dissipated in the thermal 
reservoir Q 

For equilibrium purposes with just one heat bath, the relevant thermo- 
dynamic potential is the Helmholtz free energy. Its statistical mechan- 
ical version is 

F = --logZ, Z=J2 e ~ m 

Observe that if we change some parameter in H, e.g. the coupling 
coefficient k in (13.1 ft (for fixed temperature), then the change in free 
energy F = F(k) equals the expected change in energy: 

dF /dH\ 



where 



T~ \ ~T~ / H = H K 
an \ d/t / 



(9) = 7Y,9to*- mV) 



Z 

■q&K 



is the thermal expectation. 



In a more microscopic set-up, including a description of the degrees of freedom 
in the heat bath, one would need to specify a more exact decomposition of the total 
energy into the system part and the part that belongs to the reservoir. There would 
also be interaction terms, the coupling, that contain both system and reservoir 
variables. Obviously, some convention is then needed of what is system and what 
is reservoir variable. 

On a scale where one supposes that the 77 give the full microscopic description of 
the system, there is no associated change of entropy in the system. The total change 
of entropy (also called, the entropy production) is then also equal to —j3(H(rf) — 
H(rj)). Most of the time however, there is a further lower level of description of the 
system variables with an associated degeneracy. 
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Another important observable is the particle number. We write 

k 

N\j,k](v) = ^2v(i) 
i=j 

for the total number of particles in the lattice interval [j,k] fl Ajy, 
—N < j < k < N. By construction, here we have that the particle 
numbers Mum — 2iV + 1 are a priori uniformly bounded. The total 
number of particles is denoted by M = M[-n,n] ■ 

Making the correspondence with a gas again makes us think of a con- 
servation law, now of the total number of particles. In what follows, 
we imagine that the system is also in contact with a particle reservoir 
at its boundary. Through the endpoints % = ±N particles can enter or 
leave the system. We can also speak of a birth or a death of a particle 
at these sites. In Section 14.21 we will introduce the particle currents. 
As particles can carry energy (see e.g. the first term in (13. ip ). the flow 
of particles in and out of the system can also contribute to the change 
of energy in the reservoir, and hence to changes in entropy. 
The equilibrium ensemble that allows both the exchange of energy and 
of particles is the grand-canonical one. It gives probabilities 

p/V^] = 1 e a !>(*) e ~ mn) (3.2) 
Z 

where Z = Z(a,f3,N) is a normalization factor. The constant a is 
called the chemical potential and in equilibrium it refers to and it is 
determined by the concentration of particles in the (imagined very 
large) environment. 

3.3. Dynamics. The dynamics is given by a continuous time Markov 
process on K. We distinguish two modes of updating: 

• A particle can jump (or hop) to nearest neighbor sites. That is 
a diffusion mechanism. We will not add external fields to the 
dynamics not to impose a bulk drift or bias; 

• Particles can leave or enter the system at the boundary. That 
is a reaction mechanism. The system will be boundary driven. 

We introduce some further notation to formalize the dynamics. As we 
only consider symmetric hopping, it is useful to introduce the transfor- 
mation 

{rj(k) if k ^ i, k ^ j; 
i?(<) if* = j; (3.3) 
r)(j) if k = i 

That defines the configuration obtained from r] after switching the oc- 
cupation of the sites i,j. We allow only the hopping of particles to 
neighboring sites j = i ± 1. The rate of the transition due to that 
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diffusion mechanism is taken as 

C(iJ,rj) = exp[-| W) - H(rj))] , \i - j\ = 1 (3.4) 

where H{rj 1 ^) is the energy function after the transition and H(i]) is 
that corresponding to the initial configuration. 

Analogously, we define the rate of birth and death r\ — > rf of the 
particles as 

C(i, v ) = e~ aMi) exp \-^-(H{rf) - H(rj))] (3.5) 

- _ 

where H(rf) is the energy function after the transition to 77*, the new 
configuration after the birth or the death of a particle at site i: 

V\k) = l 1 - V{k) {{k = l (3.6) 

To be definite we take births and deaths only at the boundary sites 
i = —N, N. 

The physical interpretation of the dynamics is quite simple. Think 
of a one-dimensional channel in which particles diffuse while they enter 
or leave the system at its boundary. A biophysical realization seems 
to be found in the physics of ion channels connecting the inside and 
the outside of a living cell. The channel is a sort of opening or gate 
in the cell's membrane through which charged particles can move from 
higher to lower concentration, or following the gradient in electric po- 
tential etc. Here the relevant parameters are the values cl±n which in 
fact represent the (different) chemical potentials of the two reservoirs 
at the outer edges. 

With these definitions the Master equation governing the temporal 
behavior of probability measures on K is given by 

N-l 



d F t ( v ) = [C(i, * + 1, ?f m ) W m ) - C(i, i + 1, V )¥ t ( v )} 



dt 

i=i 



+ C(-N, V - N )HV N ) ~ C(-N, V )F t ( V ) 
+ C(N,r l N )F t (r ] N )-C(N,r ] )F t (r l ) 



(3.7) 



That equation shows how the probability to find a given configuration 
in the system evolves in time. Alternatively, the generator L is given 
by 

^ t (f(Vt)) = (Lf(vt)) (3.8) 

for functions ( "observables" ) / on K, and where (•) takes the expec- 
tation over the Markov process, including some (as yet unspecified) 
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initial distribution. Explicitly, 

N 

Lf( V ) = Y,C^^ + l,v)[f(v l ' t+1 )-f(v)} 

i=l 

+ C(-N, v )[f( v - N ) - f(rj)] + C(N, v )[f(ri N ) - f( V )} (3.9) 

Let us make a simple exercise by plugging in f{rf) = rj(i) for some fixed 
i and by taking (3 = in (I3.4l) - (l3.5p . The corresponding evolution 
equation is 

^{Vt®) = (Vt(i - 1) + rj t (i + 1) - 2r k {%)) 
when i ^ —N, N, while for i = ±7V, 

^ t (Vt(i)) = (Vt(i T 1) - Vt(i) + e-"*®[l - 2^(<)]> 

Apparently, these equations are closed in the density variables (rjtii)), 
i E An. In particular, putting their left-hand sides equal to zero, we get 
the stationary value = Ci + D for some constants C and D that 

depend on iV and on the values a±N- One checks that a_;v = fljv = a 
if and only if C = 0, D = 1/(1 + exp(-a)). When C ^ 0, then 
there is a linear density profile with slope ~ 1/N. Obviously, when 
repeating that calculation for (3 ^ 0, we run into a difficulty: the 
equation for the (rjt(i)) is no longer closed but there is a coupling with 
higher order correlation functions such as (rjt(i) rj t (i + l)). That feature 
is very generally true and it implies that we cannot simply solve the 
equationsJl The stationary distribution is in general only implicitly 
known, as solution of the (time-independent) Master equation (13. 7h 
with the left-hand side set zero. 

3.4. Path-space measure. One has to remember that a Markov pro- 
cess is a special probability distribution on paths. In our case, we have 
piecewise-constant paths. A path uj over the time-interval [0, r] starts 
from an initial configuration rjo after which it changes into r] tl , r\t % , ■ ■ ■ 
at random times t±, t 2 , . . . To be more precise we must add what is the 
configuration at the jump times as well. That is just a convention, and 
we take it that ?7t fc _ 1 = T) tk - and r\ tk = r] tk+ , or, the step-function is 
continuous from the right. 

An important transformation on path-space concerns the so called 
time-reversal O in which (Qu)t = (jJ T -ti U P to irrelevant modifications 
at the jump times making Qu again right-continuous. 

8 The problem appears in all nontrivial dynamics for many particle systems. The 
resulting hierarchy of equations is sometimes referred to as the BBGKY-hierarchy, 
referring in particular to the hierarchy of equations that appear in kinetic gas theory 
for the various particle distribution functions. The study of possible ways of closing 
the hierarchy is a major concern in nonequilibrium physics. 
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The random times are called the jump times of the process. The 
Markov process assigns a probability law to these times and to the 
corresponding transitions. There are two ingredients: the waiting time 
and the transition step. The waiting time is exponentially distributed 
with a weight A (77) that depends on the present configuration 77. That 
waiting time is directly (and inversely) related to the escape rate 

Afo) = £Vfo - t/) 

rf 

We will use the notation W(rj — > rf) when indicating one allowed but 
general transition rate. 

The second ingredient sits in the transition rates as we have them 
introduced before. When the waiting time is over, a new configuration 
is chosen so that for time 1 1 0, 

Prob[7ft = rf I 7/o = 77] = (1 - A(77) t) 8 %rf + W{r] ^rf)t + o(t) 

A more explicit realization of that path-space measure goes via Gir- 
sanov's formula, see Section [UJ 



4. Steady state 

4.1. Detailed balance. One observes from the definition (13.41) that: 

C(i,j,y) _ exp [-(3H{rf^)} = g^bfj 
C{hj,rf> j ) exp[-/3#(77)] "~ W> a [rf { ' } 

where we have inserted the ratio of probabilities according to (13.21) . 
That is verified for all values a. Furthermore, with the definition (13. 5p 
we have 

C(i,y) exp[-airfi)} exp[-/3H (rf)] . = 

C(i, rf) exp[-a 4 (l - rj(z))] exp [-0H (77)] ' 1 " ' 

If a_jv = a N = a then 

expf-a^i)] _ e^ 1 -^) 
exp[-Oi(l - rfi))} ~ e^W 
Comparing with formula (13. 2p . still for z = ±N and for 

C(i, 77) _ P^fo*] 
C(f , 77*) ~~ P^Jt/J 

Summarizing, when the particle reservoirs left and right have equal con- 
centration, then the system dynamics satisfies the condition of detailed 
balance 

Wjrj^rf) _ F^[rf] 

W{rf-^rf F^irf { ' ' 

for all allowed transitions 77 — > rf and corresponding transition rates 
W{r\ — > rf). Under that same condition a_A? = a N = a we thus have 



(4.3) 
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that (13.21) is a reversible stationary measure. The corresponding pro- 
cess is the steady state for equilibrium conditions. 

Observe that if we consider unequal rates at the boundaries a\ ^ 
then we could still try 

p/Wiv^) = exjp[-PH(r))} exp[a 1 7/(l) + a N rj(N)} (4.5) 

Zj 

as a candidate stationary distribution. In that case the analogue of 
( 14. 3 p is still verified. Yet, the condition (14.1 ft fails. 

4.2. Nonequilibrium model. Now comes the question what happens 
when ai 7^ a N . Let us first consider the left boundary of the system, 
for which we can write, see (I4.2p . 

C(-N,rj) _ ^_ /3[H{rj -N ) _ H{v)] _ a _ NMv ^-N ) 



C(-N,r)- N ) 1 } 

where Je(rj,rj~ N ) = 1 when the particle leaves the system via the site 
— N, i.e., rj(—N) = 1, and Jn{rj,rj~ N ) = —1 when a new particle enters, 
i.e., rj(—N) = 0. That is an antisymmetric current of particles, taking 
positive when the particles leave the system. In the same way we define 
the current J r (j],rj') = 1 when rj(N) = 1, rf = r] N and Je{i],i] ) = — 1 
when r](N) — 0, rj' — r) . The currents are zero otherwise. 

Taking all transitions together, we have 

W(rf -> 77)) V ' 1 

One recognizes the change of entropy in the environment: 

S( V , if) = (3AE( V , r/) - (i t AAr t (ri, v') - ^^(77, V ') 

where fig = a_ N respectively /i r = are the chemical potentials (up 
to some factor (3 that we have ignored) of the particle reservoirs left 
and right, and Ji = AJ\fg, J r = AJV r are the changes in particle number 
in the left, respectively right particle reservoir. The form (14 .TP or 



W{r) 



e sM) 



W(r}' rj) 

is known as that of local detailed balanced 



9 Remark that in l|4.7p a possible time-symmetric prefactor to the rates p.5p or 
(|3.4p will never appear; there is only the part that is antisymmetric under rj «-» rf ' . 
The fact that the entropy production appears as the source term of the breaking 
of time-reversal symmetry, is no accident but it is related to more general con- 
siderations that here are simply applied in order to obtain a reasonable physical 
interpretation of our effective dynamics, see e.g. [551 BO] . 
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The currents Je and J r appear in the conservation law for the particle 
number. The sum of these currents equals the number of particles that 
leave the system, 

MV, rf) + J r ( V , J) = Af(rf) - N{rf) (4.8) 

or 

a- N Je(r), rf) + a N J r (r), rf) = (a„ N - a N )Ji + a N {M{rf) - N(r)')) (4.9) 
I From now on, we write = a, a_jv = a + 5 so that 

w(y -> rf) _ ve*[Tf\ c „ SM) 

W(rf -> rj) ¥^ a [r]} 

The parameter S thus measures some distance to the equilibrium sit- 
uation, and enables the tentative terminology of close versus far from 
equilibrium. 

As above we define the bulk currents Ji(j],r]') to be +1 if in the 
transition t] — > rj' a particle moves over the bond % — > % + 1, and equal 
to —1 if a particle moves i <— i + 1. More generally^ we consider a 
path uj = (i] t )l =0 and currents Ji(uj), i = —N,...,N, defined by 

Ji{u) = Ji(r]o,r] tl ) + Jifa^rfa) + ... + Jj(^ n -i^r) 
In particular, J r = J N and for i < k, 

Ji(u) - J k (uj) = J\f[ i+ i tk ](r) T ) - Af[ i+ i jk ](vo) 
J e (u) + J_ N {u>) = Vo (-N) - Vr (-N) (4.10) 

Observe that the currents Jj are extensive in the time r. 

All of that is related to the process, be it transient or be it steady. 
Except for the following section however, we will be mostly interested 
in the steady state regime. It is easy to verify that we have here 
a unique stationary distribution p. It satisfies the time-independent 
Master equation (13.71) (zero left-hand side). Corresponding to p there 
is then a stationary process with distribution P p . If we look at expec- 
tations in the stationary process we write ( • ) p . 
I From the conservation laws H4.8I) and (I4.10p we have 

(Je) P = ~{Jr)p = -(Ji)p, i € 

There are alternative expressions for these expectations by using the 
dynamical equations (13.81) . For example, for i ^ N, —N, 

-(Ji) p = {C{i, i + 1, rj^rjii) - V (i + l)) p = (1 - V (N)[1 + e - a ]) p 



In fact and throughout we call current what is more like a time-integrated 
current, or a change of particle number. 
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5. Time-dependent dynamics 

5.1. Modifications with respect to Section 31 Nonequilibrium 
conditions can be obtained in a variety of ways. The above gives a 
set-up for boundary driven steady states. Another way of driving the 
system away from equilibrium is by applying an external bulk field. We 
consider here a modification which also frustrates the system (as it can- 
not simply relax to equilibrium). We remain with the same states but 
the updating becomes time-dependent. The idea is that the values of 
parameters in the Hamiltonian are changed while the dynamics enrolls. 

We have a time-dependent Hamiltonian H t so that the transition 
rates W t (i] — > r]') are also depending on the moment t of the jump 
i] — ► rf . For example, the rate for exchanging the occupation at sites % 
and j — i ± 1 is 

C t (i,j,r)) = exp[-^ {H t (t ] ) ~ H t (r)))] , \i-j\ = 1 (5.1) 
(compare with (j3.4j) ) depending on the time £. 

There is no longer a very good sense in which we can speak about the 
stationary distribution. Still we can consider for each H t , t G [0, r], the 
corresponding Gibbs distribution 

p t ( v ) = i-e-EnWe-^tW (5.2) 
Zt 

where Z t = Z t (a,/3,N) is now also time-dependent. There is an asso- 
ciated free energy 

A t = ~\ogZ t (5.3) 

In the time-dependent case, we will only work with the dynamics 
for which 5 = 0, a_ N = = a fixed, i.e., there is just one particle 
reservoir and one heat bath reservoir o 

5.2. Work and heat. When there is an energy exchange between 
system and reservoir, there is heat. For a history uj = (^)q where 
the jumps in the configuration happen at times £1,^3 ■ ■ - t n , the total 
heat Q transferred to the system is the sum of differences of energy: 

Q = H tl ( Vtl ) - H tl ( Vo ) + H t2 ( Vt2 ) - H t2 (r] tl ) + ... 

+H tn (T h )-H tn (r Hn _ 1 ) (5.4) 



- 1 



11 Wc can of course make a dynamics such that at every moment the distribution 
p t exactly coincides with (|5.2p . We could e.g. take a transition rate W t (j] — > 
rf) = pt(i]')- One can think of it as admitting an infinitely fast relaxation of the 
equilibrium process. Alternatively, one can think of an ultra-slow time-dependence 
in H t so that, before any change, the system has already relaxed to the equilibrium 
distribution corresponding to the instantaneous value. 
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On the other hand, the work W performed upon the system is a sum 
of changes of the Hamiltonian at fixed configurations: 

W = H t ( Vt ) - H tn ( Vr ) + H tn - H^th^J + ... 

+H tl {r] ) - #o(?7o) (5.5) 

Therefore, as an expression of the first law of thermodynamics, 

q + W = Ht ( Vt )-H ( Vo ) (5.6) 

is the total change of system energy between the initial and the final 
configurations r)o and r] T in the path u. 



6. LAGRANGIAN SET-UP: GlRSANOV FORMULA 

As we have seen in the course of our computation around and below 
(13. 9p . the evolution equations give a hierarchy of equations for the var- 
ious correlation functions of the stationary distribution. Solving them 
is like diagonalizing a large matrix and it is not even clear whether it 
would always permit us to extract the most relevant information. A 
more global characterization of the stationary distribution is perhaps 
obtained by going to a space-time picture. On that level the process is 
space-time local and explicit. The variables are the histories or trajec- 
tories of the system. 

Given two Markov processes on the same space K, we can consider 
two path-space measures P and P with corresponding escape rates A 
and A, and transition rates W and W. We consider all paths on the 
interval [0,r] and we assume that for all rj, 

W, W( V - r/) ^ 0} = {r/, W( V - if) ^ 0} 

We can then look for the density of P with respect to P. That density 
is a Radon-Nikodym derivative and can be written down quite explicitly 
in the so called Girsanov formula: 

gH=ex P [f (AM-A«)di + pog!|^] (6.1) 

when restricted to events that are measurable from the trajectory in 
[0, t\. The last sum in the exponential is over the jump times, as they 
appear in the path ui. We have assumed here that the two processes P 
and P start from the same configuration. If they have different initial 
distributions v and v, then a prefactor z/(??)/z/(?7), co> = ?7, must be 
added to the right-hand side of the Girsanov formula (16.11) . The for- 
mula remains intact when the process is not time-homogeneous. One 
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then adds the correct time- dependence to the escape and to the tran- 
sition rates0 

Our application of the Girsanov formula will concern time-reversal. 
If we have a distribution P on paths, then its time-reversal PQ is 
obtained via 

dPG, , dP 



{00 



dP° v " ' dP u 

for an arbitrary process P° which is reversible. The dependence on 
initial configurations is again ignored, but it is essential in the consid- 
eration of the time-reversal invariant process P°. 

7. Fluctuation relations for the entropy production 

7.1. Jarzynski equality. Recall the set-up for the time-dependent 
dynamics in Section [5j We take the case where The 
Jarzynksi identity is a relation between the work W of (15.51) and the 
change in free energy ( 15. 3ft . In the context of stochastic lattice gases, 
we get it as 

^ [e-n = e- /3A " 4 , (7.1) 
The left-hand side is the expectation in the time-dependent dynam- 
ics with fixed chemical potential (left and right) equal to a and with 
Hamiltonian H t at inverse temperature /3, started from equilibrium po 
at time t = 0. The right-hand side contains the difference 

AA = A T - Ao, (7.2) 

of free energieg^l ( 15.31) . 

Proof. To prove (17.11) we make a first application of the Girsanov for- 
mula. The two distributions correspond to our time-dependent process 
P a po on the one hand and to the time- reversed process P'tQ on the 



12 Thc formula is also not really restricted to Markov processes, or to finite state 
spaces. The more useful way of considering that formula is as a generalization of 



the Boltzmann-Gibbs formula (|3.2[) . where the essential input is that one can make 
sense of what is written in the exponential as a sum of quasi-local terms. Here we 
can speak about the action as a sum of a local Lagrangian. Indeed, if we write out 
the rates W{r] — > rf) of our stochastic lattice gas, and we take P say corresponding 
to /3 = 0, a-N = in = we obtain there a sum over space-time of local interaction 
terms. Without trying to formalize the idea, see however [35], one can thus consider 
the stationary distribution to be the projection (or restriction) of that space-time 
path-space measure to an equal time layer, see e.g. |34j . There is no a priori reason 
why that projected measure should inherit a spatial locality, see e.g. [44]. 

13 To make sure, there is no assumption that at any future time t > (including at 
time r) the distribution should be the pt of (|5.2p . We are starting from equilibrium 
at time zero, but then the system is most likely away from instantaneous equilibrium 
with respect to the Hamiltonian H t . Yet, the result of (|7.1[) is a statement about 
equilibrium free energies. We can measure these (and how they possibly depend on 
some parameter) via some nonequilibrium procedure. 
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other hand. By P a we mean the process started at time zero from 
the distribution p T and with time- reversed protocol, i.e., the rates are 

w t = W T - t . 

We have therefore for a fixed path uj with jump times ti, . . . , t n in 
the interval [0,r], that 

dPp , \ P0(^0) D / x /- q \ 

, p / n 0*0 = exp (7.3) 

with, from fl6.ll) . 

' Wi„ for -> m n -x )---W t2 {r] t2 -> % ) W tl (7^ -> 770) 
By using the detailed balance relations 

and combining that with the expression ( 15.41) for the heat, the ratio 
( I7.4j) reduces to 

Hence, looking back at (17.31) and substituting (15.21) . (15.6j) and ( 17. 2ft . we 

have 

dP a Z 

dP Pr e z 

= - AA] (7.5) 

The Jarzynski equality ( 17.11) is then an easy consequence of the nor- 
malization of path-space measures: 

dP" 6 

po 

□ 

For further background information on these relations between irre- 
versible work and free energy differences, one can check e.g. [71 [231 13"%] . 

7.2. The direction of particle current. We come back to the time- 
homogeneous nonequilibrium process as we had it first in Section 14.21 
Physically we expect that there will be a particle current flowing from 
higher to lower concentration. To be specific, let us assume that 5 > 0, 
a>-N > &n, so that the physical picture suggests that the mean particle 
current {Ji) p > 0. The question is how to actually see that. Remember 
that we do not know a thing about the stationary distribution p in 
general. Nevertheless the direction of the particle current will easily 
follow within our set-up. 
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I From the Girsanov formula (16.11) for P p with respect to P p Q, both 
started in the stationary distribution p, we have 



dP p ^ = pO^) ^ _ H ^ + aAJ ^ _ 



dP p Q y ' P (lu t ) 
Again from the normalization we have: 



(7.7) 



dP»^M = 1. 



and hence, by concavity, 



dP»log^(u;)<0. 
But, from (17.71) and by stationarity 

r dp 

0<jdP p log ^r|M = -6{J t ) p = S{J t ) p (7-8) 
We conclude that 

8(Ji) P > (7.9) 

which shows that the average direction of the particle current depends 
only on the sign of S. See [12] for a very similar analysis in the case of 
heat conduction. 

To get a strict inequality (Ji) p > is also possible for 5 > 0; it suffices to 
see that there is a non-zero probability that the current Jj as a function 
of the path uj is not constant equal to zero even when ujq = uj t . 

7.3. Fluctuation theorem. The previous results were all a direct 
consequence of the normalization condition applied to the Radon-Nikodym 
derivative (16. ip between two path-space measures. Here we go for a re- 
sult that is somewhat more detailed and concerns a symmetry in the 
fluctuations of the current. We follow the method of [381 EHl S3] but 
the present model can also be treated via [35] . 

We fix an i = —N, . . . , N and consider the current J 4 as function of 
the path over the interval [0, r]. Define the generating function q(X), 
AGlby 

q(X) = lim - log(e- XJ >) p (7.10) 
rt+oo r 

The limit exists by the Perron-Frobenius theorem, and is independent 
of i = —N, . . . , N because of (14.101) . The fluctuation symmetry is that 

q(X) = q(6-X) (7.11) 

Before providing a proof observe that q(X) is the Legendre transform 
of the rate functions of large deviations for Jj. The interested reader 
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is referred to the literature on large deviations (and the Gartner-Ellis 
theorem in particular) for more details, see e.g. [§]. The idea is that 

P p [J, ~ T j] ~ e- Tl{j \ t^+oo (7.12) 

with 

I(j)=M(-Xj-q(\)) (7.13) 

A 

Substituting the identity (17.111) . we get 

= inf ((-6 + A)(-j) - q(5 - A)) - 6j = -6 j + (7.14) 

A 

or 

I(j)-I(-j) = -6j (7.15) 
That can be again translated to an identity for (17.121) : 

The interpretation of that expression is that there exists a relation be- 
tween the probabilities of having a current +j and — j; the probability 
of having a particle current in the direction opposite to the expected 
one (5j > 0) is exponentially small with r — > +oo. The formula (17. 16ft 
has appeared before and many papers have been devoted to proving 
it in a variety of contexts. It first appeared in the context of smooth 
dynamical systems where it concerned the fluctuations of the phase 
space contraction, [T71 [16j [50] , and the result has become known as the 
(steady state) fluctuation theorem. 
We now prove (17. lip . 

Proof. By definition and since Ji(Qu) = —Ji(id), 
(e~ XJi } p = J dP p (Quj)e XJ ^ ] 
Next we insert the Radon-Nikodym derivative 

/ dP pM^^M eAJlH = JdP p (oo)exp[A+5Muj)}e XJ ^ (7.17) 
where, via (16. ip or via (17. 7p . 

A = log + Z 3 K) - H(u )) - aAAf + 5(J e (u) + J^u)) (7.18) 

Notice that \AM\ = \Af(u T )-Af(uO)\ < 2N. Further, | log p(uj T ) / p(uj )\ 
is also bounded because at any rate, pirf) ^ 0, r\ £ K. Finally, there is 
the conservation law 

J e {u) + Ji{uj) = -N { _ na (lj t ) + N hm (u Q ) (7.19) 

implying that the sum of these currents is also bounded, and \H(u T ) — 
H(l)q)\ < 4(k + B)N, see (13. ip . Hence we conclude that |A| < const 
(with a constant that also depends on iV but not on r) which finishes 
the proof. □ 
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In the case j3 = (the bulk dynamics is that of the so called simple 
symmetric exclusion process), more is known about the fluctuations of 
the current, see e.g. 



8. More nonequilibrium issues 

Only a limited review has been given in the previous sections of 
recent work on nonequilibrium aspects of stochastic lattice gases. We 
attempt to give some additional remarks. 

8.1. Escape from equilibrium. Imagine yourself enclosed in a well- 
isolated room. At time zero somebody opens doors and windows; how 
long would it take before you feel that? Probably you will become 
aware of the openings because of some air current, and its intensity 
will depend on the outdoor conditions. 

In the present section we use our model to ask a similar question. 
Suppose a probability distribution \i on K which is nonzero, ^{rf) > 0, 
only when N(rj) = m for some given number < m < N of particles. 
For the rest we assume that it is thermally distributed!^ 

fx( V ) = ±- exp[-/?if (77)] xW(v) = m) (8.1) 

We consider the dynamics of Section l4~2l in the steady state P p and we 
ask for the fraction of times that we see a fixed configuration r\: 



Pr(v) = ~ I x(Vt = V) dt 
T Jo 



That time-average is a random variable (depends on rf). An important 
question in the theory of large deviations is to ask whether these frac- 
tions resemble a given probability measure; here we ask what is the 
function /(//) so that 

P p [p T ~ fi] ~ e~ TlM } r t +00 (8.2) 

That question has been rigorously studied by Donsker and Varadhan, 
[9j[Tl], and we know an expression for /(//): 

W = -inf( — ) (8.3) 

9>o \ g / fj, 

The expectation is over the distribution /j and Lg is as before the gen- 
erator of the process acting on a function g (over which we vary in 
(18. 3ft ). It is known that in the case of a detailed balance process, the 
minimizer in (18.31) is g* = ^/Jifp. 
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X is the indicator function. 
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I From (18. 3p it is clear that we must find the function g on K that 
minimizes 



fMjj) r 



JV-1 



C(z, z+ 1, 77) s(r^ +1 ) +g( V - N ) C(-N, V ) +g( V N ) C(N, 77) 



The sum is effectively over all rj with /i(r/) > or Af(r]) = m. Since the 
configurations r] ±N have one particle more or less than r], we can put 
<?(£) = whenever 7^ m, and the minimization is over 



^ g(r?) ^ 

riGK yv /y i=l 



C(z,z + l,ri)gtf* 



Taking again the complete Donsker-Varadhan functional we have 

/(//) = {C{-NM-N)) + C{N^{N))),-M(^-) (8.4) 

9 \ g / n 

where the new generator £ only considers particle exchanges generating 
a dynamics that satisfies the condition of detailed balance with respect 
to our /i; in other words, it is typical to 'see' the distribution \i for that 
pure hopping process. It follows that the second term in (18.41) is zero 
to conclude that 

/(//) = (C(-N, rK-iV)) + C{N, rj(N))), 

The issue here is somewhat related to the problem of metastability, 
as found also in the contributions by Anton Bovier and by Frank den 
Hollander, see also |4j. At the same time, it is related to e.g. Section 
5.7 in [§] (diffusion from a domain), and from a physics point of view 
it is related to Kramers' theory, [22] . 

8.2. Macroscopic fluctuations. The previous calculation is related 
to the theory of dynamical fluctuations. There is however another scale 
of description on which similar questions become better manageable, 
that is the level of macroscopic fluctuations, static and dynamical. 
For our model, it refers to a hydrodynamical scaling in which one ob- 
serves the evolution of the density profile. After a diffusive space-time 
rescaling one finds that the density profile n t (r) obeys a standard dif- 
fusion equation, 



dn t (r) 13. ... 9 . . r _ „. 

where D(nt(r)) is the diffusion 'constant,' further constrained by im- 
posing the boundary conditions p(±l) = 1/(1 + e a± ). In the simplest 
case (corresponding to (3 = 0) the diffusion is truly constant and the 
stationary profile n* is linear. One can however ask for fluctuations 
around that (typical) behavior. The hydrodynamic equation is the re- 
sult of a law of large numbers and we can ask for the plausibility of 
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a deviating density profile. We refer to [TJ [T31 EH HI] for further re- 
sults and insights. 
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Part II. 
Macroscopic irreversibility 

9. Introduction 

Up to now we have been discussing so called mesoscopic systems, 
or more precisely, classical mesoscopic systems modeled as stochastic 
processes. Time-reversal symmetry was broken by applying external 
conditions, frustrating the system in its return to equilibrium. How- 
ever, the microscopic laws of nature are time-reversal invariant. One 
could then perhaps have expected to find that all resulting behavior 
is invariant under time-reversal, except perhaps for some microscopic 
interactionsEl That is not what we see: systems return to equilib- 
rium thereby showing the infamous arrow of time. The equations of 
macroscopic physics are not time- reversible (or not always) . They have 
often been described and been used quite some time before their mi- 
croscopic origin was clarified. In fact their (macroscopic) irreversibility 
once casted doubt on the kinetic and atomistic picture of matter and 
motion. One of the greatest successes in the pioneering days of sta- 
tistical mechanics was then indeed the explanation of that manifest 
irreversibility. 

That the emergent macroscopic laws are irreversible is not so dif- 
ficult to understand at least qualitatively. One should realize that 
distinct macroscopic states can be very different in the number of mi- 
crostates they consist of. It is the installation of an initial macrostate 
that breaks the invariance under time-reversal: unless forbidden by 
additional constraints, a less plausible initial state evolves to a more 
plausible macrostate and finally to the most plausible, called equilib- 
rium, exactly because that is more plausible. The plausibility is mea- 
sured in terms of the 'number' of microstates or, more precisely, by 
the Boltzmann or counting entropy which has a well defined thermo- 
dynamic limit (a precise meaning of that counting needs to be and will 
be specified). The generic increase of the entropy between initial and 
final macrostates (traditionally both in equilibrium) is known as the 
second law of thermodynamics and can be formulated in various ways. 
Still, even more is often true: considerations of entropy via counting 
the microstates consistent with a given macrostate, are a priori not 
restricted only to the initial and the final states and can be applied 
to each intermediate, 'nonequilibrium' state as well. Extended in that 
way, the Boltzmann entropy is often an increasing function of time, as 
was first demonstrated for the Boltzmann equation, the macroscopic 

15 A11 would probably agree e.g. that the weak fundamental interaction is not at 
all responsible for macroscopic irreversibility, and most would probably agree that 
quantum mechanics is not either (while this is somewhat more tricky). 
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evolution equation for rare gases, and rigorously proven in the so called 
Boltzmann-Grad scaling limit and for short times by Lanford, [32] . 
Such a much more detailed or 'microscopic' version of the second law 
proves to be valid much beyond the Boltzmann equation; for general 
theoretical arguments see pHl E3 EE1 CEE1 EH ED HE] . 

I From a mathematical point of view, the second law in the form of 
an H-theorem in fact claims the existence of a Lyapunov functional for 
a class of evolution equations, and it even hints at how to find that: 
if we know the underlying microscopic dynamics from which the evo- 
lution equation (presumably or provably) follows, one is to search for 
the Boltzmann entropy. Understanding why this strategy often works 
brings to the foreground some other important observations: the va- 
lidity of a macroscopic evolution equation means that there is a typical 
macroscopic behavior in the sense that it is a result of some law of large 
numbers. The fact that the macroscopic equation is often first order 
in time means that this macroscopic behavior is autonomous. On the 
other hand, the existence of microscopic configurations violating that 
typical macroscopic law is not only allowed but in a sense it is even nec- 
essary for a true irreversible behavior and a strict increase of entropy 
to occur! When formulated somewhat more precisely, these observa- 
tions answer various apparent paradoxes as formulated by Loschmidt 
and Zermelo; a qualitative discussion can be found on various places, 
see e.g. [331 El EE]. 

Putting these arguments on a mathematically more precise level is 
relatively simple but it remains very instructive. First, in Section HOI 
we study a model introduced by Mark Kac, [2H]. The arguments are 
formulated in a substantially more generality in Section [TT] (the case 
of infinite dynamical systems) and Section [T21 (the case of large but 
finite systems). In particular, we explain how an H-theorem follows 
from the very existence of an autonomous macroscopic dynamics. The 
resolution of Zermelo's and Loschmidt's paradoxes is understood via a 
fluctuation symmetry, in this way drawing a link to the first part of 
these lectures. Most of the presented material and some more details 
can be found in [11 J and references therein. 

Since the fundamental laws of nature are presumably quantum, one 
can further ask how the classical arguments leading to H-theorems 
need to be changed when starting from a quantum microscopic dynam- 
ics. There is no crucial difference up to one important point, namely 
that the very notion of a macroscopic state needs to be reconsidered 
because it can be (and in nonequilibrium practice it often is) speci- 
fied through values of mutually incompatible observables. The non- 
commutativity is a genuine quantum-mechanical feature which cannot 
be simply waived away by arguments identifying the classical limit 
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with the thermodynamic limit. Furthermore, entropic arguments and 
microscopic derivations all together play on the level of fluctuations, 
i.e. before the thermodynamic limit. Starting from Section [121 we ex- 
plain a possible approach to the quantum problem along the lines of 
reference p2], thereby generalizing some ideas of John von Neumann, 
[16] . An interesting side problem is to show how our construction of the 
quantum Boltzmann entropy relates to other, mathematically simpler 
but physically a priori less plausible constructions. In fact, we show 
when two definitions of quantum entropies become equivalent in the 
large system limit. That issue is obviously very related to the problem 
of quantum large deviations and we will briefly describe the connec- 
tions. Finally, as an example, we come back to the Kac ring model and 
we discuss its quantum extension along the lines of reference [TU]; see 
Section O 

10. Kac ring model 

There is a simple paradigmatic model introduced by Mark Kac [29] to 
simplify the mathematics of the Boltzmann equation. While the Boltz- 
mann equation is much more complicated, the Kac model is mathemat- 
ically simple and free of those extra technical problems that are not re- 
ally important for understanding some crucial aspects of the emergence 
of macroscopic irreversibility. 

10.1. Microscopic dynamics. Consider the set A = {1, ... , iV}. We 
imagine it as a ring in which we identify the sites 1 = N + 1 and on 
each site we have one particle and one scatterer. The particles carry a 
'spin' r](i) = ±1 and the scatterers can be off or on, g(i) G {0, 1}. The 
resulting set K = { — 1, 1} A x {0, 1} A is the state space of our model. 
The dynamics is deterministic and given via the transformation U on 
K, 

(U(<n,g))(i) = {[l-2g{i-l)]7i(i-l),g(i)) mod N (10.1) 

which generates the (microscopic) deterministic dynamics such that 
the configuration (j] t , g t ) at time t — 0, 1, ... is 

Vt (i) = r?o(* ~t)[l- 2g(i -*)]... [1 - 2g(i - 1)] (10.2) 

and g t = g keeps constant. There is an obvious interpretation: at every 
time instance t, each spin rjt(i) jumps to its successive site, i + 1, either 
flipping its value if a scatterer is present, g(i) = 1, or keeping its value 
if g(i) = 0. Sampling the initial configuration (770, g) from a measure 
fio on K, the probability to find (7/, g) at time t is 

IH[{V,9)] =Va[(Vt,g)} (10.3) 
That is the present variant of the Liouville equation for mechanical sys- 
tems. Here also the Shannon entropy £(//) = — J2 V g ^[(Vi 9)} ^E^iiVi fl 1 )] 
is time- invariant, S(fM t ) — S(fi ). There is just no strictly increasing 
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Lyapunov function for this dynamical system; in fact, the dynamics is 
2N— periodic. Nevertheless the model exhibits relaxation to equilib- 
rium; to see that, we need to pass to a macroscopic viewpoint. 

10.2. Macroscopic evolution. There are two natural macroscopic 
observables, the magnetization m N and the fraction of on-scatterers 
P N : 

N N 

mAr = ^5>«' ( 10 - 4 ) 

i=l i=l 

The emergent macroscopic dynamics will have the form 

(mf , p N ) » (m» +1 ,p N ) = 0(mf , p N ) (10.5) 

at least for very large N. It would imply that the macroscopic data 
(m^ , pf) evolve autonomously, irrespectively of any actual microscopic 
configuration (r] t ,g t ) that realize (110.41) . A simple heuristics^ suggests 
4>(m, p) = ([1 — 2p]m, p) as a candidate map. Yet, it is easy to imag- 
ine microscopic configurations that violate that and the question arises 
how such a macroscopic behavior can/must be understood. 

Introducing the counting probability measures 

F N [( V ,g)} = 2~ 2N (10.6) 

and the notation a = b for \a — b\ < 5, the desired statement has the 
form of a law of large numbers!^! 

lim F N [m N ( Vt ) = m (l - 2pf \ m N ( Vo ) = m ; p N (g) = p\ = 1 (10.7) 

ATfc>o 

for all 5 > 0. This means there is a set of typical microscopic configura- 
tions satisfying the macroscopic law with map 0; those configurations 
violating that law make a set of zero limit measure. Such a macroevo- 
lution is called autonomous; note that (110.71) is equivalent to 

lim P^Vt < T : m N {r) t ) = m (l-2p)* | m N (r] ) = m ; p N (g) = p] = 1 

TVToo 

(10.8) 

for all 5 > and any finite T. 

The relaxation to equilibrium along that typical macroevolution is 
obvious by inspection but one can also construct an explicit witness 



16 Think of N(l ± m) up (down) spins crossing 'on average' N p scatterers every 
time step, entirely neglecting possible time correlations. Such a hand- waving deriva- 
tion is often referred to as Stosszahlansatz (or repeated randomization, molecular 
chaos approximation,...). 

17 In fact, a strong law of large numbers is also true for this model, see 29;, but 
the weak law is sufficient for our purposes. Later we will meet an even substantially 
weaker autonomy condition. 
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which is the Boltzmann entropy s(m, p) defined as the large deviation 
rate function for the sequence (m N , p N ) N ^ +OQ of observables: 

¥ N [(m N (7]), p N (g))} ~ (m, p)] ~ (10.9) 

This is to be understood in the logarithmic sense after taking the limit 
iV | +00, i.e., it is a shorthand for the limit statement 

s{m, p) = lim lim — log F N [m N (j]) = m; p N (f]) = p] (10.10) 

This is simply the binomial entropy, 

■i±™ l g(l 4. m ) _ k^l l g(l _ m ) 

s(m,p) = \ -plog2p - (1 - p) log 2(1 - p) if - 1 < m < 1, 0<p<l 
-00 otherwise 

(10.11) 

and one checks that s(4>(m, p)) > s(m, p) whenever m^fl (system off 
equilibrium) and < p < 1 (nonsingular macrodynamics). Using the 
notation m< = mo(l — 2p)*, it yields that s(mt, p) is a strictly increasing 
function of time. Following Boltzmann's terminology, such a statement 
is called an H-theorem; the Boltzmann entropy is a Lyapunov function. 

It should be clear that we say nothing yet about possible macroevo- 
lutions corresponding to those exceptional microstates not verifying the 
macroscopic map 4>. That will come in Section [10.3I 

Proof (110.71) : Use the shorthand 

E N [-] = E N [.\m N (r ]0 ) = m 0] p N (g) = p] 

for the expectations conditioned on the initial macrostate (mo, p). One 
easily checks that (1) F N are permutation-invariant measures, (2) 770 
and g are independently distributed under F N , and (3) the following 
asymptotic decoupling is trueQ provided that —1 < m < 1 and 
< p < 1, there is a sequence A^, lim^r = for all A; = 1,2,..., 
such that 



E N [r,(i 1 )...r ] (ik)]-^ N m]) k \<^N ) (10.12) 



and 



lE^iO.-.^-CE^a)])*! <A$ (10.13) 
for all 1 < %\ < i 2 < ■ ■ ■ < ik < N 



18 This property can be recognized as an instance of the equivalence between 
microcanonical and canonical ensembles. 
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Then, one subsequently gets 
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E N [m N (r, t )] = 1 J2 -t){l- 2g(i - t)} . . . {1 - 2g(i - 1)}] 

i=l 

= E n [t)q{1)\ E N [{1 - 2g(l)} ... {1 - 2g(t)}] 
= m {(l-2E N [g(l)]Y + A N } 
= mo(l - 2pf + o(l) 

(10.14) 

by using that |Ajv| < Aj$ due to (110. 13|) . Similarly for the second 
moment, 



E"[(m"(t*)) a ] = 1 £ E^[77o(l) !*,(<)] E"[{1 - 2g(l)} ... {1 - 2p(t)} 

i=l 

x {l-2g(i)}...{l-2g(i + t-l)}\ 

(10.15) 

Observe that for t+l<i<N + l — t there is no pair of the g's in the 
above product, acting on the same site. Hence, using the permutation- 
invariance and the asymptotic decoupling fll0.12p - fll0.13l) . 



, N+l-t 

E N [(m N ( Vt )f] = - {ml + B N (i)}{(l-2M N [g(l))f t + C N (i)} 



i=t+l 

N 



+ £ ){™ 2 o + B N (i)} 

i=l i=N+2-t 

xE N [{l-2g(l)}...{l-2g(t)} 

x{l-2g(i)}...{l-2g(i + t-l)}] 

N - 2t + 1 9/ , w 
= ^ mfj(l-2p) 2t + o(l) 

= m 2 (l-2p) 2t + o(l) 

(10.16) 

since the remainders satisfy \B^f[i)\ < A N , |Cjv(i)| < Ajy for all z, 
and using a simple bound on the last term. The weak law of large 
numbers (110.71) then follows from (110. 14p and (110.161) via a Chebyshev 
inequality. 

Remark that there is a considerable freedom in the choice of the 
measures from which the initial configurations are sampled. The 'mi- 
crocanonical' measure 

F N [ ■ } = F N [ • I m N ( V ) = m ; p N (g) = p] (10.17) 
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is most natural but for obtaining (110.71) . it can be replaced by various 
other ensembles. There is for example the 'canonical' measure 



1 - 

= ^exp^(/377(i) +ag(i)) (10.18) 

~' i=l 

with the Lagrange multipliers (3, a being fixed by the conditions 

= m , Ef an [s(l)] = p 

and Z N is the normalization factor. It is easy to check that the auton- 
omy (110. 7p remains true if replacing P^ with P^ n ; in fact, the proof is 
simpler now since P^ n exactly factorizes and hence the above remain- 
ders A N , B N , Cn as in fllU. 14j) and fllU. 16j) are zero. 
The corresponding large deviation rate function s can (rj,g) which enters 
the law 

KA{™ N {V),PF(9)) * KP)1 * e"*-^ (10.19) 

can also be computed (the easiest via the Gartner-Ellis theorem, [§]) 
with the result s can (m, p) = s(m,p). This equality shows the equiv- 
alence of ensembles on the level of entropies, which is well studied 
in equilibrium statistical physics. We come back to the problem of 
equivalence within a quantum framework and in a substantially larger 
generality in Section [13.41 

10.3. Irreversibility and entropy production. Consider a modifi- 
cation of the microdynamics (110.11) in which the particles jump to the 
left instead of to the right. It is given by the map 

(U(ri,g))(i) = ([l-2g(i)]ri(i + l),g(i)) mod N (10.20) 

which is an inverse of U, i.e., UoU — UoU = 1. The spin configuration 
at time t as evolved from r\ through the dynamics U is denoted by fj t : 

f)t(i) = Vo(i + t)[l- 2g(i + t - 1)] ... [1 - 2g(i)] (10.21) 

Observe that the sequence (trajectory) (7/0,7/1, . . . ,r) t ) is allowed (pos- 
sible) under the original microscopic dynamics iff (r) t , 7ft_i, . . . , %) is 
possible under U. That invertibility is referred to as dynamical (time- 
reversibility. It can be formulated differently by extending the config- 
uration space K with a 'velocity' variable v G { — 1, 1} and by defining 
the dynamics via the transformation 

[{U{r],g),v) iiv = -l 

With the involution n, Tr(j],g,v) = (j],g,—v) the dynamical reversibil- 
ity gets the form: it o V o it = V^ 1 ; the time-reversed microscopic 
dynamics is then achieved by inverting the velocity v. 
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The macroscopic time-evolution in which m \— > (1 — 2p)m e [—1, 1] 
is invertible as well (provided that p ^ ~). Yet, the typical macro- 
scopic time-evolution corresponding to U is not _1 but rather again, 
i.e., the law of large numbers (110.71) stays true when replacing U and 
i] t with U and 77^! It simply means that the macroscopic evolution 
m 1— > m(l — 2p) does not get inverted by starting from a typical micro- 
scopic configuration 77 corresponding to the macroscopic state m(l— 2p) 
and by applying the inverted microscopic dynamics (or by inverting the 
velocity). Naturally, there exist microscopic configurations 77 for which 
the inverted macroevolution m(l — 2p) 1— ► m along the dynamics U 
would be observed — this is precisely what the dynamical reversibility 
claims — they show up to be exceedingly exceptional under m(l — 2p), 
however. This physical impossibility to invert the macroscopic evolu- 
tion is referred to as macroscopic irreversibility. 

The macroscopic irreversibility in the above sense on the one hand 
and the strict increase of the Boltzmann entropy on the other hand, 
are often used as synonyms. Let us formulate their relation a bit more 
precisely. Observe that the two sets 

{(Vo,g) ■ m N (r] ) = m ; m N (r] t ) = m t ] p N '(g) = p} 

and 

{(rjo,g) : m N (fj t ) = m ; m N (r) ) = m t ; p N (g) = p} 

with m t = mo(l — 2p) 1 have the same cardinalities (check that the 
map U is a bijection between these sets). Hence, they have the same 
measures under ¥ N , which we write as 

logP-^ [m N (r) t ) = m t \ m N (r) Q ) = m ; p N (g) = p] 

+ \ogF N [m N (r ]0 )lm 0] p N (g)l p } 

= logP Ar [m Ar (r/ 4 ) = m \ m N (r) ) = m t \ p N (g) = p] 

+ \ogF N [m N ( m )lm t - p N {g)^p] 

Dividing by N, taking the limits f 00 and 5 J, in this order, and 
using the law of large numbers (110.71) , we get the large deviation law 

lim lim — log \m N (fj t ) = mn I rn N (vo) = Tn>t\ P N (q) = p\ 

sio n^oo N 1 yi ' 1 v 1 ' ' P vy; PJ (10.24) 

= s(m ,p) - s(mt,p) 

or 

F N [m N (f] t ) ~ m I m N (r] ) ~ m t ] p N \g) ~ p\ ~ e - N M m ^p)- s ( m o,P)] 

(10.25) 

which is quite a remarkable relation. Notice first that it provides an- 
other derivation of the H-theorem: since the left-hand side is less than 
one, one immediately gets s(m t , p) > s(m ,p). Further, the left-hand 
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side is nothing but the probability that a configuration r] sampled from 
macrostate m t and evolved according to U, exhibits the macroscopic 
transition from m t to m , which is just an inversion of the typical 
transition m i— > m t . 

Macroscopic irreversibility amounts to the statement that such in- 
verted macroscopic transitions are physically impossible; here we have 
a quantitative evaluation how rare they really are: the large deviation 
rate function for the backward transition m t i— ► mo with respect to U 
just coincides with the entropy production along the typical macroevo- 
lution m i— > m t with respect to microscopic dynamics U. Inverting 
the logic, this can be read off as a formula for the entropy production, 
possibly useful provided that the probability of those rare backward 
transitions can be evaluated or estimated. 

The seeming inconsistency between the microscopic reversibility and 
the macroscopic irreversibility is known as the Loschmidt paradox. 
Equality ( 110. 25ft in a sense solves this paradox and put it in a correct 
perspective: those macroscopic trajectories obtained by time-reverting 
the typical ones (0 4 (m); t = 0, 1, . . .) are indeed observable for finite N, 
however they are exponentially damped. Notice that (110. 25p is nothing 
but a macroscopic analogue of the detailed balance condition (14.41) that 
we have already discussed in the context of lattice gases. 

11. Infinite systems 

The above analysis of the Kac model shows up to be quite generic and 
one can easily extend those arguments to a more general setup. The 
aim of the present section is to formulate general sufficient conditions 
for the existence of a Lyapunov function for a class of macroscopic 
dynamics, or, equivalently, for an H-theorem to be valid. 

11.1. Dynamical systems, macrostates, and entropy. On a mi- 
croscopic level, we consider a family of classical dynamical systems 
(K N , , F N ) ni+oo, where the label N should be thought of as a spatial 
extension of the system and the maps^ (U^) t >o are assumed to satisfy 
the semigroup condition Uf = U t+S for all t, s > 0. The proba- 
bility measures F N are invariant under the dynamics: F N (U N )~ 1 = P . 

The macroscopic level of description is specified by a collection of 
macroscopic observables. These are some maps M N : K N t— > Q into 
a metric space (Q, d) of macrostates. We assign to every m G the 



Depending on an application, the maps C/ t can be e.g. Hamiltonian flows, 
possibly with the time and space suitably rescaled with TV. The details are not 
really important for what follows, we will only require the microscopic dynamics to 
satisfy a few general conditions, see below. 
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Boltzmann entropy defined as the large deviation rate function under 
the measures P^: 

s(m) = hmlimsup — logP^fM^x) = m) , meQ (11.1) 

using the shorthand m = m' whenever d(m, m') < 5. Denote 

fi = W G fi; s(m) > -oo} (H-2) 

the set of those macrostates that are admissible; we assume fio 7^ 0- 
Note this is a first nontrivial assumption: the parametrization by N 
and an eventual rescaling have to be meaning ful so that (M N ) indeed 
satisfies the large deviation principle with a finite rate function s(m) 
on some large enough space f2 . 

11.2. Autonomous evolution and H-theorem. Starting from a mi- 
croscopic configuration x G K N , the macroscopic trajectory is simply 
the collection (M N {U^ x)) t >o- We assume the existence of an au- 
tonomous macroscopic dynamics in the following sense: let there be 
a collection (<pt)t>o of maps <ft '■ satisfying 

(1) the semigroup condition 

<pt o 4> s = <pt+s , t,s>0 (11.3) 

(2) a weak autonomy condition 

lim lim i- \ogF N [M N (U t N x) = 4> t (m) \ M N (x) = m] = (11.4) 

for allt > and m G Qq. 
Notice that (11 1 .4j) is a much weaker condition than the law of large 
numbers ( 110.71) valid for the Kac model. In particular, no typical 
macroscopic evolution is required to exist; that (<f>t)t>o can e.g. be a 
single realization of a stochastic process describing a macroscopic evo- 
lution of a system passing through a number of branching points^ 
On the other hand, this condition is generally not satisfied by stochas- 
tic systems on mesoscopic scale and/or without involving the large N 
limit. In that sense, condition (II 1.4j) draws a sharp border line between 
macroscopic and mesoscopic systems. 

Since F N is invariant under C/ t , conditions flll.3D - flll.4jl are equiv- 
alent with a single condition 

lim lim — \og¥ N [M N (U t N x) = t (m) | M N (U s x) = (f> s (m)] = 

(11.5) 

20 To have in mind a specific scenario, think of a ferromagnet being cooled down 
from a high-temperature paramagnetic state. When passing the critical tempera- 
ture, the system randomly (= depending on the initial microscopic configuration) 
chooses one of the ferromagnetic states with broken symmetry. 
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required for alH > s > 0. Using the invariance P again, we find that 
for any pair m, m' G of macrostates, 

logP 7V (M 7V (x) = m!) = \og¥ N (M N (U t N x) = m!) 

> logF N (M N (U t N x) = m' | M N (U?x) = m) 

+ \og¥ N (M N (Ufx) =m) 

(11.6) 

which we are again going to divide by N, to take the upper limit 
N | +oo and then to take the limit 5 | 0. Choosing first m = 4> s (m) 
and m! = <p t (m), autonomy condition (111.51) yields 

s{(j) t {m)) > s{(j) s {m)) , t>s>0 (11.7) 

which is an H-theorem. Second, for m = 0t(m) and m' = <p s {m) it 
yields the inequality 

- limlimsup — \ogF N (M N (U t N x) = <p s {m) \ M N (Ufx) = <p t {m)) 

> s(<f) t (m)) - s(<f) s (m)) (11.8) 

again for all t > s > 0, which provides an upper bound on the Boltz- 
mann entropy production. 

For an invertible microdynamics (U^) inequalities flll.7|) - (lll.8l) can 
be turned into a single equality by essentially repeating the computa- 
tion of Section MM see Th e result reads 

s{<f) t {m)) - s(<f>.(m)) = J,, t (Mm), <t>s{m)) > (11.9) 

where 

- J S)t {m,m') 

= limlimsup — log F N [M N {U t N x) = w! \ M N {Ufx) = m] (11.10) 

s l° Nt+oo N 

is the rate function for the transition from macrostate m at time s 
to macrostate m' at time t along the time-reversed dynamics C/ t = 
(U^) -1 . The conclusions of Section 110.31 apply as well in this gen- 
eral case: Js,t(0t(m), (f> s (m)) is a natural 'measure' of macroscopic irre- 
versibility, and we have proven it is just equal to the entropy production 
for the transition <f) s (m) i— > <^(m) fulfilling the autonomy (111.51) . 

Semigroup condition f l 11 . 3 [) is crucial and cannot be simply relaxed. 
Indeed, assuming only the autonomy in the form (111.41) . one would still 
have the inequality between the initial and final Boltzmann entropies: 
s(0i(m)) > s(m), t > 0, however, s(m t ) might not be monotone in 
general. As an example, think of the macrodynamics <f> t : R i— > R 
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given as <pt{ m ) — mr 1 cosut, \r\ < 1, which is like the position of an 
under damped pendulum swinging around its equilibrium position. 

The missing semigroup property can be recovered by including addi- 
tional macroscopic observables; in the case of the pendulum one would 
naturally add its velocity as another observable. To conclude, the semi- 
group condition is basically a restriction on the choice of the collection 
of macroscopic observables, which needs to be in that sense 'complete.' 

12. Finite systems 

In this section we evaluate the necessity of the large iV limit in the 
above arguments, and we attempt a microscopic formulation of the H- 
theorem for an entropy defined upon a finite system and as a functional 
on microscopic configurations. 

12.1. Zermelo-Poincare paradox. For any fixed iV the dynamical 
system (K, Ut, P) = (K , U t r , P^) is really a finite size system; this is 
encoded by the assumption that P is a probability (and hence normaliz- 
able) measure. For simplicity, we consider in this section a macroscopic 
observable M : K i— > Q such that 

Q = {me P[M _1 (m)] > 0} (12.1) 

is finite or countable. As entropy function we take 

S(m) = logP[M -1 (m)] , m G Q (12.2) 

The well-known Poincare recurrence theorem then reads that for 
P— almost every microstate x G K and any time to one has M(Utx) = 
M(x) for some t > to, i.e., the trajectory almost surely returns back to 
the initial macrostate M(x). This is usually phrased as the impossibil- 
ity for the entropy (112. 10p to be an increasing (nonconstant) function 
of time, which is also known as the Zermelo (-Poincare) paradox. How- 
ever, the analysis in the previous section and the Kac example give 
a clue: the recurrence time increases with the system size A" and is 
shifted away to infinity in the thermodynamic limit 

In the context of H-theorems it is instructive to reformulate Zermelo's 
objection in still a slightly modified way. There is in fact a tempting 
'trivialization' of the argument leading to the H-theorem which goes as 
follows: 

For our finite system, the autonomy could simply mean that the 
macroscopic evolution as specified by a map <fi : Qq h- > fi is just what 
takes place for almost every microstate, i.e., that for P— a.e. x G K one 
has 

M(U t x) = 4>t{M{x)) , t > (12.3) 

21 For the Kac example the recurrence time is of order N. However, in many 
dynamical systems it goes exponentially with the number of degrees of freedom, 
which is itself e ^. 
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Were this indeed true as such, it would automatically imply the semi- 
group condition since, almost surely, 

M{U t+s x)=<p t {M{U s x)) = <p t o<p 3 (M{x)), t,s>0 (12.4) 

Second, it would mean that 

¥{{U t )- l M~ l (m t ) n M-^m)] = P[M _1 (m)] (12.5) 

with mt = 0*(m), i.e., the set of microstates M _1 (m) evolves to a 
subset of M _1 (m t ), up to a zero measure set. Hence, 

S(m t ) = hgFKUt^M-^mt)} > P[M _1 (m)] = S(m) (12.6) 

due to the invariance of P. Finally, 

S(m t ) = S(<h-,(m a )) > S(m s ) , t > s > (12.7) 

On the other hand, by the above Poincare recurrence, S(m t ) = S(m) 
for infinitely many t, and hence S(m t ) is constant! 

The above computation shows that the assumption of autonomy in 
the form (112. 3p or (112. 5p is too strong. If fulfilled, the macroscopic evo- 
lution would necessarily be reversible and the entropy constant. Our 
condition of autonomy (111.41) is much weaker and it does not guar- 
antee the semigroup property. In the Kac example, the law of large 
number (110.71) is far stronger than autonomy (111 .4j) . yet still consistent 
with a macroscopic irreversible evolution, as we have checked explicitly. 

12.2. Microscopic H-theorem. We come back to the general frame- 
work of Section 111.11 and consider again a sequence of dynamical sys- 
tems (K , U t ; , P ) at and a general macroscopic observable M N : K — » 
Q, macroscopic in the sense that Qq defined in fill ,ip is nonempty. Our 
aim is now to formulate an H-theorem for Boltzmann entropy assigned 
to each microstate of a single, possibly large finite-size system. Put it 
differently, we want to see how much the entropy is allowed to fluctu- 
ate around a monotone path when evaluated along a single microscopic 
trajectory of a single dynamical system with iV large but fixed. 

For N fixed the Boltzmann entropy is no longer unambiguously de- 
fined since the sets {x; M N (x) = m} depend on the width 6 > and are 
not necessarily all disjoint for different macroscopic states m. To be safe 
we assign to every microstate x G K N the interval [S<' s (x), S>' s (x)] of 
entropies defined as 

S<> S (x) = inf {S N ' s (m); m = M N (x)} (12.8) 

S>' S (x) = sup {S N ' s (m); m = M N (x)} (12.9) 

where 

S N > 5 {m) = logP JV [M JV (x) = m] (12.10) 
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We impose the autonomy assumption in the form of a law of large 
numbers: 

lim lim F N [M N (U t N x) = <fi t (m) \ M N (x) = m] = 1 (12.11) 

610 JVt+oo 

for all m G Qq, t > 0, and with maps (fit '■ l— *• such that 

(fit ° 4>s = <fit+s, t> s>0. 

Let us fix some initial condition m G Qq, 5 > and a finite sequence 
of times = to < t\ < . . . < tQ. Combining assumption (112. lip with 
the semigroup condition, the remainder 

D N ' s (s,t;m) := 1 - F N [M N (U t N x) = <fi t {m) \ M N (Ufx) = <fi s {m)\ 

(12.12) 

satisfies lim^o hnijvt+oo D N,s (s, t; m) = whenever t > s > 0. By 
subadditivity, 

f n [m n {u n x) I ^ (m)) j = i ; ... ; Q | M N (x) ± m] 

Q 

>l-^2D N ' S (0,tj;m) (12.13) 

i=i 

Whenever m N ' (Utx) = 0t(m) then 

S<' S (U?x) < S N ' s ((fH(m)) < S>' 5 (U t N x) (12.14) 
As a consequence, (j!2. 13j) gives 

F N [S^ 5 (U t .x) < S N > s {cj> tj {m)) < S^ s (U t .x), j = 1, . . . , Q \ M N {x) L m] 

Q 

>l-J2 DN ' S (°^f m ) (12.15) 

3=1 

Entropies at successive times satisfy the inequality following from (112. 12ft : 

S N > s {<fi tj (m)) > S^i^im)) +log(l -D^it^t^m)) (12.16) 
Using that 

Q 

lim lim minlog(l - D N ' s (t j „ 1 ,t j ;m)) = (12.17) 

<5J.O N1+oo j=l 

inequalities (112. 151) — ( j!2. 16h yield the main result of this section: 

For any A > 0, m G Qq, and a finite sequence = to < t\ < . . . tQ of 
times, one has 

\im\m^¥ N [S^ 5 (U t3 x) > S^' 5 (U tj ^x)-A, j = 1, . . . , Q | M N {x) I m] = 1 

(12.18) 

Therefore, the finite-system entropy violates the monotonicity as little 
as required with probability arbitrarily closed to one, provided that 5 is 
small enough and N large enough. This is the announced microscopic 



:!cS 



H-theorem. 

Remark that the ambiguity with the definition of finite-system en- 
tropy does not arise if the observables M N take only finitely or count- 
ably many values (as in Section fl2. II but this time uniformly for all N). 
In that case, one can set 5 = and the entropy is simply 

S N (x) := S%'°(x) = S>'°(x) = logP iV [(M iV )- 1 M iV (x)] (12.19) 

(Compare with (112.21) .) The microscopic H-theorem (112.181) then be- 
comes, under the same assumptions, 

lim ¥ N [S N (U tj x) > S N (U tj _ 1 x) - A, j = 1, . . . , Q \ M N (x) = m] = 1 

7V|-j-oo 

(12.20) 

13. Quantum systems 

The arguments presented in the previous section do not dramatically 
change when passing from a classical to a quantum dynamics. What 
does need to be refined however, is the very description of macroscopic 
states due to the inherent incompatibility of quantum observables, as 
visible from the noncommutativity of corresponding (self-adjoint) op- 
erators before any macroscopic limit is taken. 

Obviously, the question of a quantum fluctuation theory and of quan- 
tum limiting behavior is not restricted to nonequilibrium physics. The 
difference between equilibrium and nonequilibrium macroscopic states 
lies mainly in the choice of macroscopic constraints. The constraints 
describing equilibrium (like energy, particle number) usually commute 
and hence the problem we discuss here typically falls in a nonequilib- 
rium context. 

A first attack on this problem dates back to John von Neumann, [J6] . 
His idea went as follows: The single particle position and momentum 
operators Q, P satisfy the commutation relational [Q, P] = i. Hence, 
assigning copies Q i: P i; i = 1, . . . , N to each of N particles, the averages 
Q N = iEift. pN = wEiPi satisfy [Q N ,P N ] = f Although they 
do not commute and hence cannot be diagonalized together (nor simul- 
taneously measured), one can think of suitable modifications Q , P N 
that already commute and that in a sense well approximate the origi- 
nals, at least for large N. Indeed, von Neumann explicitly constructs 
commuting operators Q , P N which have purely discrete spectra of 
nondegenerate eigenvalues (q^iPa)™, an d whose eigenvectors (ipa)a 
make a complete orthonormal basis system in L 2 (IR). They approxi- 
mate the operators Q , P N in the sense that 

{€, Q N €) = 9? , p n €) = p N a (i3.i) 



Set the Planck constant to one. 
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and 

11(^-^)^11 < 11(^-^)^11 < 4= (13-2) 

V -/V v iv 

with C ~ 60, see E6] for details. 



What follows is a slight modification and generalization of the above 
idea that comes close to the point of view of quantum information the- 
ory. Instead of modifying the operators themselves, we look for the 
largest or typical subspaces that in some sense well approximate the 
eigenspaces for given eigenvalues, simultaneously for all macroscopic 
observables from a collection. This construction proves to be natural 
since the corresponding entropy, measuring the dimension of that typ- 
ical subspace, actually satisfies a variational principle. Hence, it can 
be directly compared with another, more familiar although physically 
less satisfactory construction based on maximizing the von Neumann 
entropy. The (non)equality of both entropies is then a problem of 
(non) equivalence of ensembles. Looked at from another angle, such an 
equivalence gives a counting interpretation to the von Neumann en- 
tropy in the thermodynamic limit, and opens interesting possibilities 
towards a consistent and meaningful scheme of quantum large devia- 
tions. 

13.1. Quantum macrostates and entropy. A macroscopically large 
quantum system is modeled by a sequence of finite-dimensional Hilbert 
spaces (7i N ) Nt+oc on which we have standard traces Tr^. As macro- 
scopic observables we consider a collection M N = (M^) k£l of self- 
adjoint operators on 7i N \ for simplicity, we assume I to be finite. For 
each operator there is a projection- valued measure Qf on R such that, 
by the spectral theorem, 

HM? ) = / Q%(dz) F(z) , F e C(R) (13.3) 

(which is just to say that is unitarily equivalent to a multiplication, 
or simply that can be diagonalized.) A quantum counterpart of 

the classical set of microstates = rrik for some macrostate nik G R 
is the projection 

Qu' S {rn k ) = / fif(dz) (13.4) 

13.1.1. Commuting observables. As a warm-up, assume first that M N 
is a collection of mutually commuting operators. In that case, Q N (dz) = 
Ylkei Qk (dzh) is a common projection- valued measure, (113.31) extends 
to 

F(M N ) = [ Q N (dz)F(z) } FeCiR 1 ) (13.5) 
Jr 1 
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and a macrostate m = (m k ) k€l gets represented by the projection 

Q N ' s (m) = Jl Q k ' 5 (m k ) (13.6) 
kei 

The classical entropy, say in the form (112.101) . extends to 

S N ' s (m) = logTr N [Q N ' 5 (m)] (13.7) 
This is a formalism entirely equivalent to the one for classical systems. 

13.1.2. General observables. For a general collection M N of observ- 
ables and a macrostate m e R 1 , projections (V n )n-\+oo ar e said to be 
concentrating at m, written V N —>■ m, whenever 

lim tr^Mf ) | V N ] = F(m k ) (13.8) 

iVf+oo 

is satisfied for all F G C(R) and k G /, with the notation 

tr ^r.ipAri £| J (139) 

Tr [P-^l 

for the normalized trace on V N 7i N . Condition (113.81) is a law of large 
numbers for observables under quantum state (113.91) ; it can be 
equivalently written as the condition 

lim tT N {Q^ s (m k )\V N ] = l (13.10) 

N ] + DO 

for any 5 > and k E I. Physically, it means that all \ l k . k E I are 
asymptotically dispersionless under state (113. 9p . 



Having in mind the classical situation where the entropy counts the 
number of all microstates x such that M N (x) = m, we are mostly inter- 
ested in those concentrating sequences that are maximal in the sense of 
dimension counting. Hence, we define the (infinite-system, Boltzmann) 
entropy s(m) for any m = {m k ) k£ i by the variational problem 

s(m) = lim sup — log Tr N [V N ] (13.11) 

i.e., s(m) is the largest limit point over all projections concentrating 
at m. Any projections V N attaining the entropy s(m) in the large N 
limit, 

limsup — log Tr N [V N ) = s(m) (13.12) 
ivt+oo N 

are then called typical projections concentrating at mo Clearly, they 
provide a variant of the microcanonical ensemble for noncommuting 
observables. An example comes in Section [TH 



23 Note a slight difference in the terminology with respect to [T^] where the typical 
concentrating projections were rather called a microcanonical macrostate. The 
present terminology is closer to the one of quantum information theory. 
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To check that the above definition of entropy is meaningful, we first 
revisit the relation between the macroscopic autonomy and the H- 
theorem of Section 112.21 in the present quantum set-up. Second, we 
link our construction to the canonical construction based on maximiz- 
ing the von Neumann entropy, and we prove that they are equivalent 
under suitable conditions. 



13.2. H-theorem. As a microscopic dynamics we consider a family of 
automorphisms^ ( , r/ v )t>o acting on the observables from B(H N ) and 
having the semigroup property 

T t N T? = T» 8 , t,s>0 (13.13) 

Denote 

Q = {me R 1 ; s(m) > 0} (13.14) 

the set of all admissible macrostates. The conditions on the emergent 
macroscopic dynamics now have the following form, cf. Section 112.21 
There are maps (4>t)t>o on satisfying 

(1) semigroup condition: <p t ° 4> s = <Pt+s, t, s > 0; 

(2) autonomy condition: for every m G fi there exist some typical 
projections V N — > m concentrating at m such that for all F G 
C(R), k G I, and t > 0, 

lirn tr^[rf F(M» ) \ V N ] = F((0,m) fc ) (13.15) 

N T+oo 



or, equivalently, 



lim lim tx N [T^Qf\{(j> t m) k )\V N ) = 1 (13.16) 

5i0 iVT+oo 

Under these condition it is easy to prove that 

s{4> t m) > s((f> s m) , m G flo, t > s > (13.17) 

Indeed, let V N ->mbe typical projections concentrating at m and 
verifying (113.151) or (113. 16p . Using that r t is invertible and (t^) -1 is 
again an automorphism such that Tr ((r/^) -1 -) = Tr (•), one has 



ti N [{r t N )^V N } (13.18) 
tr N [F(M» ) | (rf )^V N \ 



24 This means that t?(XY) = T t N (X)r N (Y) for any X,Y £ B{H N ), which 
is a noncommutative generalization of classical deterministic map. Physically, 
(H N , , Tr N ) models a closed quantum dynamical system; note that Tr N (rf (■)) = 
Tr (•) and hence Tr corresponds to the invariant (counting, unnormalized) clas- 
sical measure. 
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Hence, autonomy 013.151) implies that (r t fj 1 V N concentrate at 0tm, 
(t*)- 1 T n -> t m@ As a result, 

s(m) = limsup^logTr^r/V 1 ^] < s{<p t m) (13.19) 

By combining with the semigroup property, 

s(4> t m) = s(4> t -s ° s m) > s(4> s m) (13.20) 

as claimed. 

Notice that in (113. 15I) - (I13. 16ft we have required the autonomy con- 
dition in the sense of a law of large numbers; compare with a much 
weaker assumption (111.41) . A possible way how to prove the H-theorem 
under a weaker autonomy condition here too, might be via suitably 
weakening the notion of concentration and by modifying the definition 
of entropy; we do not discuss this issue. 

13.3. Canonical formalism. Von Neumann has introduced the en- 
tropy functional on states uj n (-) = Tr N [p N -] over B(7t N ) by 

&{u N ) = - Ti N [p N \ogp N ] (13.21) 

For trace states on subspaces of H N , given as uj^ n (-) = Tr N [P N - ] / Tr^ [P N ] 
the von Neumann entropy boils down to 

&(lu% n ) =logTr N [V N } (13.22) 

In this light, entropy (113. lip can also be written as 

s(m) = limsup — - (13.23) 

A general and very successful approach in statistical physics lies in 
the idea that a variational principle like (113. 23p can often be extended 
to a larger 'test space', so that (1) a new variational problem becomes 
easier to solve, and (2) the resulting entropy s(m) can be proven to re- 
main unchanged. This is a standard approach at least when describing 
thermal equilibrium, but it is often used in a similar way to describe 
nonequilibrium macroscopic states (sometimes then referred to as con- 
strained equilibria). 

To obtain the canonical description for a given macrostate m e M. 1 , 

we write uo N — > m for any sequence of states satisfying lim7vt+oo u N \M^) = 
ink, k & I (convergence in mean). Analogous to (113.231) . we define the 
canonical entropy, 

Scan(m) = limsup — - — (13.24) 

»r 1 -IV 



2 r , 



Note they do not have to be typical concentrating projections at ^m! 
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Any sequence of states (u ) n^+oo such that linijvt+oo &(oo )/N = s 
we then call canonical states at m. 



An advantage of this formulation is that one can often find canonical 



states explicitly in a Gibbsian form: consider states = Tr N [p N 



defined as 

JV -_L e NI2 k X k M» ^ ^ = Tr iV [eJ V Efc A fc Mf ] (13 25) 



with some A = (\k)kei- If limjvt+oo ^xi-^-k) = m fc> k £ I, then 
(co^) Art+oo are canonical states at m. 

This easily follows from the positivity of relative entropy, see e.g. [3]: 

for any oo N — »■ m, u; Ar (-) = Tr^fp^- ], 

lim sup - - J- w N [log p^] < lim sup [log ] 



lim sup ^- log - VAa (13.26) 



7VT+oo 

= lim sup-— [logpf] 

Aft+oo 

as claimed. It also yields the canonical entropy in the form 

Scant™) = P(A) - ^fc m ^ (13.27) 

where we have defined the 'pressure' 

p(A) = limsup — log.2f (13.28) 

13.4. Macroscopic equivalence. By construction, s can (m) > s(m). 
A natural question arises under what conditions both entropies are ac- 
tually equal. This is a familiar problem of the equivalence of ensembles 
(microcanonical versus canonical in this case) on the level of entropies, 
however, the usual arguments, e.g. [371 EH EE] , are mostly restricted to 
the case of equilibrium and commuting observables (with the energy 
and/or the particle number as the only variables). The generalized 
microcanonical ensemble in the sense of Section 113.1.21 requires some 
refinement of those arguments. Below we provide some sufficient con- 
ditions for the equivalence. 

Let (o)^)ni+oo t> e canonical states (113.251) with oo^ — > m. Assume 
that 

(1) the limit 

p(A)= lim llogTr^fe^^*^] (13.29) 

TVT+oo JV 
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exists and has the derivative ^« I -1 = ^k^k m k] 
(2) for any j G I, the generating function 

qj{K)= l im Itogll^^^^^f] (1330) 
exists and has the derivative d<? j — I =m,. 

&K, I K=0 J 

Under these hypotheses we will prove that 

s(m) = s can (m) = ^ ^km k - p(X) (13.31) 
fee/ 

Remark that by the Golden- Thompson inequality!^! 

<&(«) >p(A + (0,...,(k),-,...,0)) (13.32) 

Unless Mjy all mutually commute, this inequality generically becomes 
strict and those (qj)jei are fundamentally different from the pressure; 
they appear naturally when studying quantum large fluctuations, see 
Section 113.51 

The proof of equivalence (113.311) comes in a sequence of steps: first 
we show that the canonical states are exponentially concentrating 
at m, then we construct typical projections for these states, and finally 
we prove that those typical projections concentrate at m too. 

13.4.1. Exponential concentration. By assumption, qj exists in some 
interval [—/to, «o]> K o > 0. From the spectral theorem (113.31) . 

q j (K)=p(\) + Jim llogo^e^f] 

= P ^ + Jl m ¥ log / W ?1W1 eKzN ( 13 - 33 ) 

= p(X)+ lim llog / if(d*)e~" 



where we have introduced the (classical) probability measures vf as 
the distribution of Mj under states . Denote the last term as 
and fix some 5 > 0. One has the estimate 

/ vf{dz) e KzN > e< m ^ N vf[z > + 5] (13.34) 
Jr 

which implies, by the existence of the limiting generating function, 



1 



limsup — log Vj[z > mj + S] < if)j(K) — K(rrij + 5) (13.35) 



iVt+oo 



N 



26 £ a+b < e A e B f or a ll hermitian matrices A, B. 
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for all < k < k . Since -^-\ K=0 = nij, there exists Ki = Ki(5), 
< k-i < k such that t/> 3 -(/ci) < Kiirij + Hence, 



limsup — logz/^fz > nij + 5] < (13.36) 

Nt+oo N ' 2 



Combining with an analogous argument for [z < rrij — 5], we arrive 
at the bound 

u?[Cfi > 1 - (13.37) 
valid for all 5 > and iV > A^(<5), with some Cj(S) > and Nj[S); the 
Qf' 5 (rrij) is given by f)13.4p . 

This in particular implies that states are concentrating at m(A) 
in the sense of a law of large numbers analogous to (113.101) ; moreover, 
the concentration is exponentially fast. Note that the above argument 
is similar to the construction of large deviation upper bounds, cf. any 
textbook on the large deviation theory, e.g. [9j [23] . 

In an analogous way we exploit assumption (1) on the pressure. This 
time we consider the observable J2 k ^kM^ and denote by Q N the cor- 
responding projection- valued measure, i.e., such that 

F(V \ k M» ) = / Q N (dz) F{z) , F e C(R) (13.38) 
k 7r 

Repeating the arguments (113. 33f) — ( 1 13.3 71) . we get the result 

u%[Q N > s ]>l-e- G ® N (13.39) 

with 

qn,6 = I QN( dz ) x (J2 X k m k -5<z<J2 ^m k + 5) (13.40) 
J ^ k k 

valid again for all 5 > 0, JV > N(5), with some C(S) > and N(6). 

13.4.2. Typical projections. From (I13.39j) there is a sequence 5n I 
such that the projections V N = Q n > Sn satisfy 

lim ^[V N ] = 1 (13.41) 

N J+oo 

By construction one has the operator inequalities 
V N (J2 ^m k - 5 N ) <V N J2 < V N (J2 X ^k + 5 N ) (13.42) 

k k k 

which yield the upper bound 

Tr N [V N ] = u$ M)-^"] < Z^e- N & Xkmk - SN )uj^[V N } (13.43) 
and the lower bound 

Tr N [V N ] > Z^e- N ^" Xkmk+&N )^ [P N ] (13.44) 
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Using (PUD and (jT5T77l) . this proved 

lim ^-logTr^P^^-V^m^^H (13.45) 

./VT+oo iv ' 

As soon as we prove that projections V N are concentrating at m (see 
the next section), the last equation simply means that s(m) > s can (m). 
Since the opposite inequality is obvious, we arrive at (113.311) as claimed. 



The arguments used in this section are well known in both classical 
and quantum information theory, and projections V N satisfying (113. 41 j) 
and (113.451) are usually called typical (sequence of) projections. Their 
existence under mild assumptions for a large class of models is a subject 
of the Shannon-McMillan (-Breiman) theorem, see e.g. [3] and references 
therein. For a nice overview of the principles of quantum information 
theory see [8]. 



13.4.3. Concentration of typical projections. To finish the proof we 
need to show that V N as constructed in the last section concentrate at 
m. The following is true for any Y N > 0: 



^[Y N ] = Tr N [(p^Y N (p^i 



A 



> Ti N [V N (p^)^Y N (p^V N ] 



Tr N [(Y N f>r N p»(Y N ) k >] (13 . 46) 



> _L e ^(E fc A fe m fc -<5iv) x r ^[p^] tr N [Y N I V 

> e- 2N5N u N [V N } tr N [Y N | V N ] 



'TV 



where we have used inequalities (I13.42[) and (I13.44H . Take now Y 
1 — Qf' e (rrij) and use the exponential concentration property of , 
inequality (113.371) ; one obtains 

1 _ tr N [Qf' e ( mj ) | V N ] < e-VM-MrtN^NpN^-i (13 _ 47) 



for any e > and iV > Nj(e), which immediately give; 



2S 



lim tr^Q v ' e (m,) | V N \ = 1 (13.48) 

iVt+oo 



Repeating for all j G /, this proves V — > m. 



27 Note that one only needs that lirn/vj +00 -4= logTr^p^] = 0. In particular, 
the assumption on the differentiability of the pressure is convenient but far from 
necessary; see also a comment below. 

28 Note it actually yields an exponential concentration, even under that weaker 
assumption limArj +00 logTr w ['P Ar ] = 0. 
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13.5. Towards quantum large deviations. Using the notation of 
Section UnmH the Gartner-Ellis theorem of (classical) large deviations, 
[9. 23J, teaches us that whenever the generating function ry, G C^R) is 
differentiable and strictly convex, one has the law 

lim lim — log v^\z = rn.,-1 = —L(mA (13.49) 

x\n /vt~-, AT J L JS v ' 



for any rhj such that rhj = ^"| K=K („ .) f° r some (unique by assumption) 



lim Jim —\oguj^[Qf' s (m j )] = -I j (rh j ) (13.51) 



hat rhj = - 

K,(rrij), and with the rate function Ij being the Legendre transform 
Ij(rhj) = supjK^ - lirn^ — logo;* [e KNM f] } 

= snp[Krhj — qj(n) +p(X)) (13.50) 

K 

= K{rhj) rhj - qj(K(rhj)) + p(A) 

(Naturally, for m such that oo^ — > m one has K(rrij) = and Ij{rrij) = 
0.) In terms of the canonical states , (113.49)) becomes simply 

1 

~6\0 JVfToo A" 

This is an exponential law for the outcomes of measurements of the 
observables Mj , upon the canonical states . This gives an interpre- 
tation to qj as the corresponding generating function. 

The existence and differentiability of qj gets nontrivial whenever the 
observables are more complicated than just something like the spa- 
tial averages of one-site observables over a lattice (a simple example are 
the observables M^, M^, in the quantum Kac model, Section [141 . 
In the usual context of quantum lattice models, no general argument is 
known even for the existence of qj{n), which is in contrast to the case of 
pressure p(A) where the situation is rather well understood, [5U EH E]. 
For some partial results about the existence of qj in the so called high- 
temperature regime see [45], [49] ; the differentiability is studied in [45] . 

By means of the Varadhan lemma, [§] , formula (113.51)) can be equiv- 
alently written as 

lim I logu»[e NF ^} = sup{F(^) - /,.(*)} (13.52) 

N]+oo iV z 

for any F G C(M), for simplicity assumed to be bounded from above. 
This form provokes still another related question, namely the asymp- 
totic limit 

lim l.] og Tt> T [AE* x * u ?+F(M?)) ] (13 53) 

7VT+oo A" J v ' 

Although this is likely not directly related to the quantum fluctuations, 
such formulas appear naturally when studying lattice models with a 
combination of short-range and long-range interactions. Some authors 
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consider this formulation as a genuine problem of quantum large devi- 
ations; see e.g. [UJ where the authors show the above limit to exist in 
the case of being averages over one-site spin observablesj^l They 
prove the following variational principle: 

(H333D = sup{F(z) - Ifo)} , I'j{z) = sup{/« z - gj(/c)} (13.54) 

2 ' K 

</,(«) = hm ^-logTr N \e N (^ XkM ^ +KM ^} (13.55) 

which is similar to fll3.49l) - fll3.50l) up to the modified generating func- 
tion q'. 

A general and systematic quantum large deviation theory is lacking, 
however, and remains an interesting open question. Possibly even more 
ambitious, both physically and mathematically, would be the problem 
of correlated large fluctuations for noncommuting macroscopic observ- 
ables. Some ideas on this issue can be found in [2j; also the present 
construction of generalized microcanonical ensembles, Section 113.1.21 
seems related to this problem. 

14. Example: quantum Kac ring 

This is a quantum extension of the Kac ring model of Section [10] 
introduced and studied in [Tj)J [TT] . Consider a ring A = {1, . . . , iV} 
again, and associate with each site i a quantum spin r](i) G C 2 and a 
classical variable g(i) G {1,0} that indicates the presence respectively 
the absence of a scatterer. The state space of the model is hence 
7i N x K N with Hilbert space Tt N = C 2N (spins) and classical space 
K N = {0, 1}^ (scatterers). 

14.1. Macroscopic description. As macroscopic observables we con- 
sider the operators 

1 N 

M «= jvX>°(0, a = 1,2, 3 (14.1) 

8=1 

where a a {i) are copies at site i of the Pauli matrices 

1) , • ~q) > -3= (J _ X ) (14.2) 

representing three components of the local 'magnetization', and 

1 N 

M$ r (g) = j;52g(i) (14.3) 

i=l 

the density of scatterers. By construction, [Mf, = jjM^ (and 
cyclic permutations). The classical (= commutative) case is restored 
by keeping e.g. and as the only macroobservables. 



'This in particular mean that the canonical states are product states. 
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It is sometimes convenient to embed K N in C 2N and to utilize a 
compact notation for both operators on 7i N and classical functions on 
K N . In this sense we speak below about states over TL N x K N , and we 
use the shorthand Tr^ = ^2 geK N Tr N ■ 



In the canonical framework, 



.N / \ ' 



A 



e -Afp(A)rj r AT jgEfcl (A09(i)+ELl Aa<T„(i)) . j 



;i4.4) 



are product canonical states, and the pressure is 

p(A) = -1 logfr^^^-o A <* M « ] = log2[(l + e A °) cosh |A|] (14.5) 

with the shorthands A = (Ai, A 2 , A 3 ) and |A| = (A^ + A^ + Ag)^. Further, 
uj^ — > m where 

m = = (1 + e" Ao ) _1 , m a = = ^ tanh |A| , a = 1, 2, 3 
d\ d\ a |A| 

(14.6) 

The canonical entropy is then, m = (mo, m), 



! III ) = p(X) - 22 \>">» 
a=0 

l+N lncr 1+ l r "l _ 1- H loo- 1 ~l r "l 
2 1U 6 2 2 & 2 

—mo logm — (1 — m ) log(l — m ) if |m| < 1, < m < 1 
— oo otherwise 

(14.7) 

cf. the classical case, (110. lip . 

To obtain a microcanonical description in the sense of Section ["13.1.2l 

we associate with any macroscopic state m = (m ,m) the modified 
macroscopic observable (M^,M N ), 

3 1 N 

m^E>"4E^). * = t?t* ( 14 - 8 ) 

^ \m \ a N ^ w m v y 

and the modified macrostate (m , |m|). 

Since a is unitarily equivalent to e.g. 03, i.e., a = Wa^W^ with some 
W' = W -1 , we are back at the classical (commutative) situation. De- 
noting by Q N (dz) theprojection-valued measure for (M^ , M N ), one 
easily checks that anjo Q N ' SN (m , \m\) such that 5^ j. 0, are concen- 
trating projections at (mo, |m|). Moreover, if N^Sn T +°° then these 



30. 



The notation is the same as in Section fl 3. 11 
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are typical concentrating projections at (m , \rh\) and the entropy is, 
as essentially can be read off from the classical formula (110. lip . 

s(m ,\m\)= lim - logTr^Q^K, \m\)} = s can (m , m) (14.9) 

A^T+oo iv 

In the last step, we need to show that Q N ' 6N (m , \rh\) are also con- 
centrating at m = (mo,m), that is the macrostate under the original 
(noncommuting family of) macroscopic observables M . This can be 
proven by essentially repeating the argument of Section [13.4.3( we leave 
it to reader as an exercise. As a result, those Q n ' Sn (itiq, \fh\) are typical 
projections concentrating at m = (mo,m). 

14.2. Microscopic dynamics. To model the scattering of quantum 
spins (represented by vector 77) on the binary variable g, consider a 
unitary matrix V on C 2 , 

V = e it \ h={h 1 ,h 2 M (14.10) 
Let the dynamics on 7i N x K be given as, cf. ( 110. II) . 

U N (m 9) = (g(N) V V (N) + (1 - g{N)) V (N), 

g(l)Vrj(l) + (l-g(l))rj(l),..., 
...,g(N-l) Vrj{N - 1) + (1 - g(N - 1)) V (N - 1); g) (14.11) 

extended to a unitary operator in the quantum sector by linearity. The 
associated automorphisms are then 

Tt N (.) = (I/*) -* . (U N Y (14.12) 

14.3. Macroscopic dynamics. Let us start with a heuristic argument 
in the spirit of Boltzmann's Stosszahlansatz. Any macrostate m = 
(m , fa) can be associated with the quantum state of a single 'effective' 
quantum spin, via the 2x2 density matrix 

v — ~(1 + rh ■ a) , Tr[z/ a a ] = m a , a = 1,2, 3 (14.13) 

Each time step the effective spin either meets a scatterer (with prob- 
ability mo) or not (with probability 1 — mo). Hence, its evolution is 
presumably u 1— ► v t — 0*(v), 

${y) = m VuV f + (1 - mo) v (14.14) 

by construction enjoying the semigroup property. Using (114. 10p and 
(114.131) . this can be explicitly written as the evolution on macrostates: 
m t+ i = 4>(m t ) where 

0(mo, rh) = (mo, rh — 2mo[(n x rh) sin \h\ cos \h\ — n x (n x rh) sin 2 \h\]) 

(14.15) 
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with the notation n — h/\h\. One easily checks that h -m is invariant 
under 0; the evolution can be visualized as a spiral motion in the plane 
perpendicular to n. Provided that \h\ 7^ 0, ir, 2n, . . . and m G (0, 1), 

lim 0*(mo, fh) = (mo, (n ■ fh) ft) (14.16) 

t|+oo 

and the relaxation is exponentially fast. The monotonicity of the en- 
tropy s(m t ) can also be easily verified. 

A rigorous argument showing that the above heuristics is indeed 
correct was given in |10| . employing a strategy similar to that for the 
classical Kac model, Section 110.21 The result reads that for a large 
class of (sequences of) states uo N — > m, including in particular 

• the (microcanonical) states ti N [ - \ Q N,&N {m 1 \fh\)] under those 
typical concentrating projections at m constructed in Section H4.lt 

• the canonical states from (114.41) : 

one has the law of large numbers: 

u N [r t N F(M»)) = F{{<p t m) a ) , a = 1, 2, 3 (14.17) 

for all F G C(M.) and with given by (114. 15ft . Hence, one verifies the 
autonomy condition (113. 15H . 

14.4. Exercise. Consider {M$ , Mg) as a new macroscopic observ- 
able. Check that the data (m , m 3 ) are macroscopically equivalent 
with (mo, 0,0,777.3) for the original 'full' macroscopic observable M N ; 
therefore the autonomy just follows from (114. 171) . Calculate the en- 
tropy s(mo, m.3) and show that it oscillates as a function of time. How 
can this apparent failure of the H-theorem be explained? 

15. Concluding remarks 

The text has discussed some newer and some older issues of nonequi- 
librium physics. Main emphasis has been on fluctuations and on the 
relation between entropy and irreversibility. One could say that ev- 
erything has been an exploration of the idea that entropy production 
is a measure of irreversibility. Some central identities have been (14.71) . 
(17. 5p . (110.251) and (111.91) which all point to the deep connection between 
source terms of time-reversal breaking and statistical thermodynamic 
quantities. They go beyond standard irreversible thermodynamics be- 
cause fluctuations play an essential role here. As known since long, the 
deviations of thermodynamic behavior are important in the very un- 
derstanding of its microscopic origin. These relations go also beyond 
the standard schemes as they are not perturbative and they do not 
require linear approximations or closeness to equilibrium. 

Nevertheless there is also a sense in which all that has been at- 
tempted here does remain very close to the standard perspective. We 
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do not mean only that there is not really much fundamentally new 
since Boltzmann's statistical interpretation of entropy. It is true that 
progress has been very slow and we have been writing mostly from the 
point of view of the rear-guard, dissecting arguments and explanations 
that have been won long before. What we do have in mind however 
is that the theory so far remains very much restricted to direct com- 
parisons with equilibrium. The obsession with time has mostly been 
an interest in the passing away of structure, of deleting memory and of 
ending in equilibrium — all the time centering around the second law of 
thermodynamics, and often applying Markovian schemes or justifying 
molecular chaos. We hope that the lectures that are summarized in the 
preceding sections have indeed clarified some of these issues, but we do 
not want to leave the reader without trying to provoke some feeling of 
totally different directions. 

The most sensational instances of nonequilibrium physics are prob- 
ably not be found in the problem of relaxation to equilibrium nor in 
the installation of nonequilibrium via standard thermodynamic forces 
for which the linear response theory appears to be working well even 
quite far from equilibrium. What needs to be understood is the con- 
structive role of fluctuations far away from equilibrium. For example, 
understanding nonequilibrium aspects in life processes be it for molec- 
ular motors or for the problem of protein folding, requires fundamental 
studies in reaction-rate theory. Ratchet mechanisms and the physics of 
transport and dissipation on very small scales must be part of it also. 
Nonequilibrium issues that are related to macroscopic structure (even 
on cosmic scales), to pattern formation and to the organization of ro- 
bust steady behavior are mind-boggling, but one has to open them also 
via the methods and the traditions of mathematical statistical physics 
when one wants its role to go further than "simplification and reduction 
of the results of previous investigations to a form in which the mind 
can grasp them.'o 
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